-- Logs begin at Thu 2022-07-21 09:54:34 UTC, end at Thu 2022-07-21 11:03:43 UTC. -- Jul 21 10:26:39.217749 dv-cinder-849800-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 10:26:39.229267 dv-cinder-849800-2-smb devstack@keystone.service[80582]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 10:26:39 2022] *** Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: nodename: dv-cinder-849800-2-smb Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: machine: x86_64 Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: clock source: unix Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: pcre jit disabled Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: detected number of CPU cores: 4 Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: current working directory: / Jul 21 10:26:39.231356 dv-cinder-849800-2-smb devstack@keystone.service[80582]: detected binary path: /usr/bin/uwsgi-core Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: your processes number limit is 47680 Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: your memory page size is 4096 bytes Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: detected max file descriptor number: 2048 Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: lock engine: pthread robust mutexes Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: thunder lock: enabled Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 10:26:39.231927 dv-cinder-849800-2-smb devstack@keystone.service[80582]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 10:26:39.275141 dv-cinder-849800-2-smb devstack@keystone.service[80582]: Python main interpreter initialized at 0x5576236b59c0 Jul 21 10:26:39.275141 dv-cinder-849800-2-smb devstack@keystone.service[80582]: python threads support enabled Jul 21 10:26:39.275141 dv-cinder-849800-2-smb devstack@keystone.service[80582]: your server socket listen backlog is limited to 100 connections Jul 21 10:26:39.275141 dv-cinder-849800-2-smb devstack@keystone.service[80582]: your mercy for graceful operations on workers is 90 seconds Jul 21 10:26:39.275464 dv-cinder-849800-2-smb devstack@keystone.service[80582]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 10:26:39.275539 dv-cinder-849800-2-smb devstack@keystone.service[80582]: *** Operational MODE: preforking *** Jul 21 10:26:39.275815 dv-cinder-849800-2-smb devstack@keystone.service[80582]: *** uWSGI is running in multiple interpreter mode *** Jul 21 10:26:39.275815 dv-cinder-849800-2-smb devstack@keystone.service[80582]: spawned uWSGI master process (pid: 80582) Jul 21 10:26:39.276011 dv-cinder-849800-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 10:26:39.276611 dv-cinder-849800-2-smb devstack@keystone.service[80582]: spawned uWSGI worker 1 (pid: 80594, cores: 1) Jul 21 10:26:39.276937 dv-cinder-849800-2-smb devstack@keystone.service[80582]: spawned uWSGI worker 2 (pid: 80595, cores: 1) Jul 21 10:26:39.277692 dv-cinder-849800-2-smb devstack@keystone.service[80582]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 10:26:44.752073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:26:44.752073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: from cryptography.utils import int_from_bytes Jul 21 10:26:44.752859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:26:44.752859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: from cryptography.utils import int_from_bytes Jul 21 10:26:44.752979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:26:44.752979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: from cryptography.utils import int_from_bytes Jul 21 10:26:44.753381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:26:44.753381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: from cryptography.utils import int_from_bytes Jul 21 10:26:44.801948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 10:26:44.802114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 10:26:44.802242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 10:26:44.802339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 10:26:44.802438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] command line args: [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 10:26:44.802498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] command line args: [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 10:26:44.802653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 10:26:44.802785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 10:26:44.802873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ================================================================================ {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 10:26:44.802954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ================================================================================ {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 10:26:44.803069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] admin_token = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] admin_token = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] config_dir = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] config_dir = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] config_source = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] config_source = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.803898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] debug = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] debug = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.804891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.805055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.805243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.805889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.805975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_config_append = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_config_append = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_dir = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_dir = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_file = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_file = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.806976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.807961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.808940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.809918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.810109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.810244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.810608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.810717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.810847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] publish_errors = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.810924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] publish_errors = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.811980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] standard_threads = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] standard_threads = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.812934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] use_journal = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] use_journal = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] use_json = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] use_json = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] use_stderr = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] use_stderr = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] use_syslog = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] use_syslog = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:26:44.813904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.813980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.814917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.815964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.816937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.817912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.818897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.819911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.820920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.821988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.822988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.823980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.824948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.825981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.826993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.827868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.828977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.829886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.830971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.831901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.832941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.833973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.834899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.835934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.836911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.837925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838174 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.838961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839085 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.839981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.external = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.external = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.840908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.password = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.password = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] auth.token = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] auth.token = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.841924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.842961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.843990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.844884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.845986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.846911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.847037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.847161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.847296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.847296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.847793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.847920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.848914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.849948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.850962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.851865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.852621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.852621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.852861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.852987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.853881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.854917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.855922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.856941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.857955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.858987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.859883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.860918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.861931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.862872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.863907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.864921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.865941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.866975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.867100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.867221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.867354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.867476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.867646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.868993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.869988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.870905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.871995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.872754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.873899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.874943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.875971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] role.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.876997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] role.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] role.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] role.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.877994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.878897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.879887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.880884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.881994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.882898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.883920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.884937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.885948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.886982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.887973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.888962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.889940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.connection = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.890876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.connection = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891847 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.891973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.892870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.893886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 10:26:44.894970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:26:44.894970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 10:26:44.919783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.920010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.920232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.920316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.920468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.920707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.928617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.929014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.957224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.957347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.957479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:44.957560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.099779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.100414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.149750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.149980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.150182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.150421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.222855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.223936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.224026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.224151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.259806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260782 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.260994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.261123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.261203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.261337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.272224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.272528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.284909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.285889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.286008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.286090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.286218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.286299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 10:26:45.303517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.303685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.303772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 10:26:45.303896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 10:26:45.304052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.304230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 10:26:45.307184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 10:26:45.307258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.307778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.316873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.317148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.317274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.317417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.317548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.317695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.317816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.318095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.326415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.327148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.329727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.329996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.330281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.330416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.330675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.330780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.330982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.331910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.332984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.333248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.359380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.360054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.360949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.361227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.361668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.361942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.366497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.366803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.367086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.367235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.367511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.368391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.375025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.375308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.375683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.375962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.379939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.380233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.380517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.380598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.380798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.380880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.381961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.382144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.382406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.401206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.401481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.401639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.401969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.406120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.406502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.409778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.410079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.410193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.410490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.415920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.416241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.419567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.419877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.423383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.423655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.423756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.423951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.424877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.425069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.444325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.444698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.444797 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.444969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.445074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.445233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.445317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.445585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.453218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.453652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.455028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.455303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.455387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.455644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.458364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.458645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.458752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.458951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.459034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.459229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.459323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.459505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.459588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.459777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.473270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.473368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.473549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.473636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.473839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.473922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.474989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.475074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.495160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.495534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.498486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.498836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.501829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.502156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.503459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.503795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.505086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.505366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.505450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.505646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.505730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.505974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.513173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.513517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.514989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.515264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.518190 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.518479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.518564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.518801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.519094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.519322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.519686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.519686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.528316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.528598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.528738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.528884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.529158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.529158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.536851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.537008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 10:26:45.537154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.537290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.537423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.537554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.537685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.537819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.537956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.538934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.539067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.539198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.539334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.540956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.541080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 10:26:45.578967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576236b59c0 pid: 80594 (default app) Jul 21 10:26:45.579852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576236b59c0 pid: 80595 (default app) Jul 21 10:26:45.582290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121023a9-4354-469f-b1aa-83be9f39aa84 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:45.582581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121023a9-4354-469f-b1aa-83be9f39aa84 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:45.582888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121023a9-4354-469f-b1aa-83be9f39aa84 None None] PATH_INFO: `/v3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:45.587211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Thu Jul 21 10:26:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:26:54.303183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:54.303724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:54.303815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:54.308875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:26:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:26:54.314075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:54.314502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:54.314622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:54.385725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: INFO dbcounter [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] Registered counter for database keystone Jul 21 10:26:54.407430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG oslo_db.sqlalchemy.engines [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:26:54.413589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writer thread running {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:26:54.588756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG passlib.handlers.bcrypt [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80594) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 10:26:54.589332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG passlib.handlers.bcrypt [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80594) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 10:26:54.643377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:26:54.645001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:26:54.768357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:26:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 10:26:54.945104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:55.017078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: INFO dbcounter [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] Registered counter for database keystone Jul 21 10:26:55.036153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:26:55.042320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writer thread running {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:26:55.162629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1b605-9008-41bf-8aea-52161aef38c7 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:55.167534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:55.168197 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:55.168485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:55.168761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:55.176935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:26:55.229183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 10:26:55.229474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498994f-e5ed-4e1b-9525-7e5908f042e1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:26:55.239149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Thu Jul 21 10:26:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:26:55.245986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:55.260537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99104642-df16-47ff-b1f7-0e0608720c84 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:55.264949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:55.266081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:55.266373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:55.266653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] PATH_INFO: `/v3/projects/1821efd315e44bfda0a46040701ac779` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:55.270801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] RBAC: Authorizing `identity:get_project(project_id=1821efd315e44bfda0a46040701ac779)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:26:55.321846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 10:26:55.322370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae91b1-a592-4d17-a1fc-d30b518bdc88 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:26:55.326777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Thu Jul 21 10:26:55 2022] GET /identity/v3/projects/1821efd315e44bfda0a46040701ac779 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:26:57.370529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2122-22fa-4ee1-87e3-055138a6f671 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:57.371100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2122-22fa-4ee1-87e3-055138a6f671 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:57.371100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2122-22fa-4ee1-87e3-055138a6f671 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:57.375293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:26:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:26:57.380736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:57.381115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:57.381289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:57.401022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:26:57.402548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:26:57.410370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:26:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 10:26:57.432221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2122-22fa-4ee1-87e3-055138a6f671 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:57.443960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2122-22fa-4ee1-87e3-055138a6f671 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:57.448650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14f974-c21a-4bf8-bddb-de690380b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:57.449253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14f974-c21a-4bf8-bddb-de690380b1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:57.449535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14f974-c21a-4bf8-bddb-de690380b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:57.449807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14f974-c21a-4bf8-bddb-de690380b1a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:57.457389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14f974-c21a-4bf8-bddb-de690380b1a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:26:57.459193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14f974-c21a-4bf8-bddb-de690380b1a7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:26:57.468421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Thu Jul 21 10:26:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:26:57.473947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:57.483132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b3cfe-877c-4edd-80d2-ff92ef1f001a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:57.487583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397526c-7028-4f3e-ae31-98fc854a77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:57.488446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397526c-7028-4f3e-ae31-98fc854a77ae admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:57.488732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397526c-7028-4f3e-ae31-98fc854a77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:57.489070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397526c-7028-4f3e-ae31-98fc854a77ae admin admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:57.490515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397526c-7028-4f3e-ae31-98fc854a77ae admin admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:26:57.492376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397526c-7028-4f3e-ae31-98fc854a77ae admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:26:57.494232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Thu Jul 21 10:26:57 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:26:59.580011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5186-d46a-4400-a963-c76385bca19e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:59.580519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5186-d46a-4400-a963-c76385bca19e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:59.580601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d5186-d46a-4400-a963-c76385bca19e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:59.581936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:26:59.588769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:59.589184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:59.589329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:59.606675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:26:59.607890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:26:59.610175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d806-15a8-41ec-92c8-429848e69ef5 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:59.610538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d806-15a8-41ec-92c8-429848e69ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:59.610851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d806-15a8-41ec-92c8-429848e69ef5 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:59.612202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:26:59.617362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:59.617657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:59.618075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:59.658841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG passlib.handlers.bcrypt [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80595) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 10:26:59.659261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG passlib.handlers.bcrypt [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80595) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 10:26:59.689901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:26:59.704958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:26:59.706554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:26:59.714120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:59.738315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:26:59.808805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:26:59.818732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e6a7-1de4-425f-8fd4-c5fdc59ec0bc None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:59.830948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:59.853288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:59.854100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:59.854383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:59.854771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:59.865849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:26:59.877407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:26:59.878302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:26:59.879368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:26:59.884994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:26:59.930322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12bada-315e-4cc7-9215-522c5c416d19 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:26:59.932611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:26:59.967348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:26:59.968087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:26:59.969037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:26:59.969323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:26:59.969597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:26:59.985163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e1e4-12c3-44c6-81ac-2fafd123e6a3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:00.020015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:00.020685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:00.020972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:00.021251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:00.022008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:00.022319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.023757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.035698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:00.037809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.039366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.041358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:00.136267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:27:00.140123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef358-a919-474c-a635-d5667b86f393 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:00.142414 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:00.145132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:00.174702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:00.175581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:00.175868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:00.176145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:00.177374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.178886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.180585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:00 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:00.185965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:00.201085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:00.242353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283a1a7-d40e-4870-8de3-181da1c25fa6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:00.277172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:00.277961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:00.278306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:00.278584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:00.285761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6930bc-130e-4444-a0b0-71d8fcd452fb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:00.299096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.300553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.320348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:00.321381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:00.321494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:27:00.321705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:00.322534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:00.323546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:27:00.323546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:27:00.323546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:27:00.323546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:00.323789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:00.323862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:00.323927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.324461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.326065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:00.328745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:00.331554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:00.386638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:00.412913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:00.430286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643917-a3d3-48c7-a291-da285d5a5b31 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:00.431811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952fdd-cf93-48b0-afad-4b7e4c1bf4f5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:00.464797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:00.465477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:00.465694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:00.465816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:00.466071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:00.466293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:00.466578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:00.466841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:00.466929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:00.467160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.467717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.domain.id=default, user.id=3d9602c060d644089af9ad7f45e2a55b) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:00.468031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:00.468607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba3bb-b027-4aa4-b0ce-3e61a066824d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.469506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9802b-4c86-47a5-8ca9-1694e52d0c7e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:00.487702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Thu Jul 21 10:27:00 2022] GET /identity/v3/role_assignments?user.id=3d9602c060d644089af9ad7f45e2a55b&scope.domain.id=default&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:00.487897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:02.838910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09243c69-4244-4281-9863-bec26fc176db None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:02.839905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09243c69-4244-4281-9863-bec26fc176db None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:02.840393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09243c69-4244-4281-9863-bec26fc176db None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:02.842273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:02.848181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:02.849013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:02.849488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:02.875707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:02.876921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:02.904194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5fbe-7f15-4752-9c7a-a459fef5eb0d None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:02.905116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5fbe-7f15-4752-9c7a-a459fef5eb0d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:02.905874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5fbe-7f15-4752-9c7a-a459fef5eb0d None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:02.908397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:02.914227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751c460-4194-484f-89f5-8104f1859afe None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:02.914848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751c460-4194-484f-89f5-8104f1859afe None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:02.915674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751c460-4194-484f-89f5-8104f1859afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:02.944185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f751c460-4194-484f-89f5-8104f1859afe None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:02.947768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f751c460-4194-484f-89f5-8104f1859afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:02.971233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:03.012899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.077089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:03.090237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:03.166739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088635-c5bc-4920-96c8-8c5c2d3c6dc8 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.181164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751c460-4194-484f-89f5-8104f1859afe None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.208746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaac836-e443-41a0-bf1d-bcde38195c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.209567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaac836-e443-41a0-bf1d-bcde38195c23 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.209854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaac836-e443-41a0-bf1d-bcde38195c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.210134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaac836-e443-41a0-bf1d-bcde38195c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.231785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaac836-e443-41a0-bf1d-bcde38195c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-eeaac836-e443-41a0-bf1d-bcde38195c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:03.242389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:03.243856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:03.244609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:03.247404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 12/26] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:03.248924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95660ca7-3de0-465a-99d0-a2701bd1bf4c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.257611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95660ca7-3de0-465a-99d0-a2701bd1bf4c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.257611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95660ca7-3de0-465a-99d0-a2701bd1bf4c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.257611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:03.257611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95660ca7-3de0-465a-99d0-a2701bd1bf4c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.301416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:03.349788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751c460-4194-484f-89f5-8104f1859afe None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.424867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95660ca7-3de0-465a-99d0-a2701bd1bf4c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.433094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:03.459390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.460198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.460478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.460750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.460936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.461638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.461970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.462384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.463376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:03.463694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:03.465100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d6c63-e1b1-438d-9594-8753b49b6784 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:03.479115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 14/28] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:03.480727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.481019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.481299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.486397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:03.487913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:03.500244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:03.501463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:27:03.523938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:03.524779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:03.526248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:27:03.526248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:27:03.526248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:27:03.526248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:03.526248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 15/29] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:03.526248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.575421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:03.576350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.687756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e9eac-cce3-435f-9044-087bd9351179 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.703070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:03.730933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8762-f7f6-45b9-9088-f85323e31416 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.734437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.735310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.735741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.736165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.737118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:03.737676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:03.739378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:03.753147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:03.754297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.762239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:03.771006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa577d-a6d4-4b95-bdd8-d0e6510b4058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.771887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa577d-a6d4-4b95-bdd8-d0e6510b4058 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.772172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa577d-a6d4-4b95-bdd8-d0e6510b4058 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.772443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa577d-a6d4-4b95-bdd8-d0e6510b4058 None admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.775313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa577d-a6d4-4b95-bdd8-d0e6510b4058 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:03.776108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa577d-a6d4-4b95-bdd8-d0e6510b4058 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:03.777792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 16/32] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:03 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:03.779020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350749-34cc-4364-a396-53bd4cb42514 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.779300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350749-34cc-4364-a396-53bd4cb42514 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.779580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350749-34cc-4364-a396-53bd4cb42514 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.781250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:03.781941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8350749-34cc-4364-a396-53bd4cb42514 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:03.869433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608f5f9-71d7-486d-9f7e-09cac14c45b4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.894424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8350749-34cc-4364-a396-53bd4cb42514 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:03.907893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bf81-427d-4a9f-bf07-6eefda5862e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.909438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bf81-427d-4a9f-bf07-6eefda5862e3 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.909881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bf81-427d-4a9f-bf07-6eefda5862e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.910615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bf81-427d-4a9f-bf07-6eefda5862e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.911607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1bf81-427d-4a9f-bf07-6eefda5862e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:03.913791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1bf81-427d-4a9f-bf07-6eefda5862e3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:03.931632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:03.932362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:03.932650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:03.936627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:03.936627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:03.936627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:04.124033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 21 10:27:03 2022] POST /identity/v3/roles => generated 225 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:04.125856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.126309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.126772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.172169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:04.174045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:04.186769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 18/35] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:27:03 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:04.186769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:04.216230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:04.311684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:04.344713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:04.392331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:04.392493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bd31-8482-4c12-bf8a-c550702b60fc None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:04.443781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692c63f-d638-48e3-8dc1-ef8f55592c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:04.444738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692c63f-d638-48e3-8dc1-ef8f55592c40 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.445050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692c63f-d638-48e3-8dc1-ef8f55592c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.445331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692c63f-d638-48e3-8dc1-ef8f55592c40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.448394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692c63f-d638-48e3-8dc1-ef8f55592c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:04.449985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692c63f-d638-48e3-8dc1-ef8f55592c40 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:04.451810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 19/37] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:04.453600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ef5c9-f732-4219-b95f-343caa696187 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.453900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ef5c9-f732-4219-b95f-343caa696187 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.454183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ef5c9-f732-4219-b95f-343caa696187 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.456048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 20/38] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:04.456996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ab56-e0e7-44db-805d-101502dab748 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.457625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ab56-e0e7-44db-805d-101502dab748 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.457911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ab56-e0e7-44db-805d-101502dab748 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.459669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 21/39] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:04.462582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.462904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.463187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.481273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:04.482873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:04.526767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c201c-62e6-412c-86c4-a7537109d54d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:04.553176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 22/40] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:04.554161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:04.560451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230dc4-32b4-48b1-b16b-de2499f4bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:04.561129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230dc4-32b4-48b1-b16b-de2499f4bd09 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.561415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230dc4-32b4-48b1-b16b-de2499f4bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.561696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230dc4-32b4-48b1-b16b-de2499f4bd09 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.562463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230dc4-32b4-48b1-b16b-de2499f4bd09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:04.563998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230dc4-32b4-48b1-b16b-de2499f4bd09 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:04.601206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:04.636865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 19/41] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 21 10:27:04 2022] POST /identity/v3/roles => generated 219 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:27:04.638172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.638462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.638766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.657273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:04.657865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9b07c-2c58-4387-9057-0c1e3ca6c78b None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:04.659262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:04.662056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:04.699457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:04.700360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.700652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.700936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] PATH_INFO: `/v3/domains/default/users/3d9602c060d644089af9ad7f45e2a55b/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.703493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3d9602c060d644089af9ad7f45e2a55b, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:04.704972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:04.739115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 20/42] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:04.739964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:04.853539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 23/43] 10.222.0.49 () {58 vars in 1361 bytes} [Thu Jul 21 10:27:04 2022] PUT /identity/v3/domains/default/users/3d9602c060d644089af9ad7f45e2a55b/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:04.854382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:04.859211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2dbb8-6b07-4c05-809a-22bf274e76cf None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:04.900660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:04.901361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:04.901634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:04.901914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:04.902714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:04.904176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:04.967028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab67a-bc59-4f06-848f-ee2982a1e615 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:04.970588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:04.982932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:04.998731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 21/44] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 21 10:27:04 2022] POST /identity/v3/roles => generated 223 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:05.005572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ad19-dfbf-4a04-843f-0e6250b45e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:05.006467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ad19-dfbf-4a04-843f-0e6250b45e58 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:05.006796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ad19-dfbf-4a04-843f-0e6250b45e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:05.007084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ad19-dfbf-4a04-843f-0e6250b45e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:05.009565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ad19-dfbf-4a04-843f-0e6250b45e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:05.010478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ad19-dfbf-4a04-843f-0e6250b45e58 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:05.012724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:05.019026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:05.135124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b187e-070c-4dde-9858-b3c8e1416a2f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:05.174101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7569a-c788-447d-a762-99006c163785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:05.174824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7569a-c788-447d-a762-99006c163785 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:05.175112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7569a-c788-447d-a762-99006c163785 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:05.175391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7569a-c788-447d-a762-99006c163785 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:05.176363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7569a-c788-447d-a762-99006c163785 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:05.177820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7569a-c788-447d-a762-99006c163785 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:05.266813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:27:05 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:06.954520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58ad4-15c0-449c-864f-7683d62a0f12 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:06.955102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58ad4-15c0-449c-864f-7683d62a0f12 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:06.955102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58ad4-15c0-449c-864f-7683d62a0f12 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:06.956490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:06.961856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e979c-ce40-41e9-b234-7b9acf9fc7fd None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:06.962277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e979c-ce40-41e9-b234-7b9acf9fc7fd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:06.962556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e979c-ce40-41e9-b234-7b9acf9fc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:06.979385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c80e979c-ce40-41e9-b234-7b9acf9fc7fd None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:06.980591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c80e979c-ce40-41e9-b234-7b9acf9fc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:07.027026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:07.047315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:07.070728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d58ad4-15c0-449c-864f-7683d62a0f12 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.277024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d58ad4-15c0-449c-864f-7683d62a0f12 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.302333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71729c4-63fd-4b20-b52b-1bf3f3d5b7ed None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.302586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71729c4-63fd-4b20-b52b-1bf3f3d5b7ed None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.302917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71729c4-63fd-4b20-b52b-1bf3f3d5b7ed None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.304364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 24/49] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:07.310057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.310469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.310785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.311412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.312211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.312507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.312785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.323648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:07.327791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:07.329010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:07.331483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:07.332294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:07.333029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 26/50] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:07.338553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.370285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:07.443585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a47115-2783-454d-9de4-091fee590d39 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.480155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.480841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.481127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.481406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.482175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:07.482484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:07.483902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:07.494223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 27/51] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:07.499711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.504313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:07.527441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.589214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:07.595875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ab35-9693-48e0-86ad-c0ca15b74841 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.627752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a615c41-30b2-4a42-89fc-90a2314ffc64 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.630442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.630739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.631030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.631303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.632514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:07.634800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:07.636412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 28/53] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:07 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:07.639287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:07.641688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.662054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.662929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.663172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.663454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.664711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:07.666189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:07.672353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 26/54] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:07.673237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.747253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6508c4-555b-4529-8c19-48decff361b4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.773992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f07a65-b873-4fb9-93d6-fd9277be489e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.781958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.782790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.783565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.783565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.784559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:07.786031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:07.787905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 29/55] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:07.793601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:07.809825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a988aa-f96b-48a6-8fb2-093e749287e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.810495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a988aa-f96b-48a6-8fb2-093e749287e5 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.810814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a988aa-f96b-48a6-8fb2-093e749287e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.811096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a988aa-f96b-48a6-8fb2-093e749287e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.811818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a988aa-f96b-48a6-8fb2-093e749287e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:07.813252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a988aa-f96b-48a6-8fb2-093e749287e5 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:07.825152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:07.891351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 27/56] 10.222.0.49 () {60 vars in 1140 bytes} [Thu Jul 21 10:27:07 2022] POST /identity/v3/projects => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:07.898826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d6d1-efb6-4b98-9630-a540224c33da None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:07.937515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:07.938191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:07.938478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:07.938787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:07.939656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.domain.id=default, user.id=3d9602c060d644089af9ad7f45e2a55b) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:07.939975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:07.941488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6615cb-d038-4c50-b218-3a3890348144 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:07.948465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 30/57] 10.222.0.49 () {56 vars in 1322 bytes} [Thu Jul 21 10:27:07 2022] GET /identity/v3/role_assignments?user.id=3d9602c060d644089af9ad7f45e2a55b&scope.domain.id=default&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:09.949990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1892-f82a-4ec0-b09d-6f5d55d0bf63 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:09.950493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1892-f82a-4ec0-b09d-6f5d55d0bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:09.950575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1892-f82a-4ec0-b09d-6f5d55d0bf63 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:09.951976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 28/58] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:09.957261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:09.957650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:09.957817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:09.974838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:09.976027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:10.040334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:10.063815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1892-f82a-4ec0-b09d-6f5d55d0bf63 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:10.093925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:10.164701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1892-f82a-4ec0-b09d-6f5d55d0bf63 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:10.197509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9164a5-8e78-4eb4-9652-5c6a3e987c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:10.198290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9164a5-8e78-4eb4-9652-5c6a3e987c97 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:10.198578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9164a5-8e78-4eb4-9652-5c6a3e987c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:10.198887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9164a5-8e78-4eb4-9652-5c6a3e987c97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:10.200134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9164a5-8e78-4eb4-9652-5c6a3e987c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:10.201572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9164a5-8e78-4eb4-9652-5c6a3e987c97 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:10.203219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 29/60] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:10.208790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:10.234107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:10.308438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faf970-8aa0-4ce6-8b20-b1f3e5c735d3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:10.342639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927929-cd35-4daf-add7-c7be2514ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:10.343390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927929-cd35-4daf-add7-c7be2514ec9b None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:10.343673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927929-cd35-4daf-add7-c7be2514ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:10.343949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927929-cd35-4daf-add7-c7be2514ec9b None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:10.344651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927929-cd35-4daf-add7-c7be2514ec9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:10.346086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927929-cd35-4daf-add7-c7be2514ec9b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:10.496133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 32/61] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:10 2022] POST /identity/v3/users => generated 275 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:13.704884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b763f-f2ae-44f1-ac41-55ad9c80368d None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:13.705402 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b763f-f2ae-44f1-ac41-55ad9c80368d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:13.705741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b763f-f2ae-44f1-ac41-55ad9c80368d None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:13.707373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 30/62] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:13.712740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee4b15-5dbf-4751-a2af-24f0a230d013 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:13.713568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee4b15-5dbf-4751-a2af-24f0a230d013 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:13.714039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee4b15-5dbf-4751-a2af-24f0a230d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:13.739699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-deee4b15-5dbf-4751-a2af-24f0a230d013 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:13.741254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-deee4b15-5dbf-4751-a2af-24f0a230d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:13.833061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:13.869568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b763f-f2ae-44f1-ac41-55ad9c80368d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:13.989518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243a24c-e8d2-4161-99b0-05b7d842e5bd None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:13.989722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243a24c-e8d2-4161-99b0-05b7d842e5bd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:13.990216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243a24c-e8d2-4161-99b0-05b7d842e5bd None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:13.991812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 34/64] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:13.999779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e86a-642c-436d-a1c2-49b5feea4345 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.000395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e86a-642c-436d-a1c2-49b5feea4345 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.000868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e86a-642c-436d-a1c2-49b5feea4345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.007565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.009981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b763f-f2ae-44f1-ac41-55ad9c80368d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.028704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-8320e86a-642c-436d-a1c2-49b5feea4345 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:14.030229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8320e86a-642c-436d-a1c2-49b5feea4345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:14.034261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.056280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c527-4ac2-4fa4-97c7-dfb5e0e8b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.057804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c527-4ac2-4fa4-97c7-dfb5e0e8b3ce None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.058510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c527-4ac2-4fa4-97c7-dfb5e0e8b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.058979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c527-4ac2-4fa4-97c7-dfb5e0e8b3ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.072631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c527-4ac2-4fa4-97c7-dfb5e0e8b3ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-6fe2c527-4ac2-4fa4-97c7-dfb5e0e8b3ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:14.081029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:14.081902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:14.082639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:14.085112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 31/65] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:14.087371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d0f2-a410-43ba-934b-c7ed3b8edb07 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.087873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d0f2-a410-43ba-934b-c7ed3b8edb07 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.088321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d0f2-a410-43ba-934b-c7ed3b8edb07 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.089810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 32/66] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:14.092739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d0f2-a410-43ba-934b-c7ed3b8edb07 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.122161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:14.122161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857ebe-db35-4dd4-b09f-cc1486d9ecef None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.122161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857ebe-db35-4dd4-b09f-cc1486d9ecef None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.122161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857ebe-db35-4dd4-b09f-cc1486d9ecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.147736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d6857ebe-db35-4dd4-b09f-cc1486d9ecef None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:14.149992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d6857ebe-db35-4dd4-b09f-cc1486d9ecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:14.219933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d0f2-a410-43ba-934b-c7ed3b8edb07 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.223156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 36/68] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:14.224696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b1fd-00f5-4bd9-8609-6d50a4852816 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.224990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b1fd-00f5-4bd9-8609-6d50a4852816 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.225272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b1fd-00f5-4bd9-8609-6d50a4852816 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.226743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 37/69] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:14.231504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b1fd-00f5-4bd9-8609-6d50a4852816 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.264027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.264622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.264904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.265189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.266123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:14.266439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:14.267867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff808f-bd10-49b3-b40b-e30ac067505e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:14.277129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 33/70] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:14.278430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc88c-447c-4b8f-bb7a-df031a859c7c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.278752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc88c-447c-4b8f-bb7a-df031a859c7c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.279036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc88c-447c-4b8f-bb7a-df031a859c7c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.282741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 34/71] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:14.282741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.282741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.282741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.299308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:14.300528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:14.308701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.315271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.339436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b1fd-00f5-4bd9-8609-6d50a4852816 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.368587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 35/72] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:14.369426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.377970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.378825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.379115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.379393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.380593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:14.382064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:14.384239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 38/73] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:14.384865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.472150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42e7ef-6817-42ed-a338-81448bef6074 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.483608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052703-6bef-43bb-9c76-091465fcb73d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.506554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c587a-c3ed-4d27-84fa-e6ad21820d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.507381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c587a-c3ed-4d27-84fa-e6ad21820d33 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.507670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c587a-c3ed-4d27-84fa-e6ad21820d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.507944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c587a-c3ed-4d27-84fa-e6ad21820d33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.517311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.517989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c587a-c3ed-4d27-84fa-e6ad21820d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:14.518123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.518407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.518683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-7d1c587a-c3ed-4d27-84fa-e6ad21820d33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:14.526263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:14.527106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:14.536800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:14.537393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.537461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 36/74] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:14.537461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.537461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.537461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.537678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:14.537678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:14.537678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 39/75] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:14.538114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.546439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:14.547672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:14.550496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.616020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 37/76] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:14.623668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.648813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce50b3-0af5-4237-8ed0-e36242b267b3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.687900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.688584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.688868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.689151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.689887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:14.691377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:14.745831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71a4a9-c8fa-418f-ba15-d6232cd67f60 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.780201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.780949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.781238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.781517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.786388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 40/77] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:14 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:14.786388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.800844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.805163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:14.813607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:14.816365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 38/78] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:14.817146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.859365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:14.916915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f154-bd45-4601-8890-26cc9ea8a86f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.935672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c717ea6-cc19-40d8-90c2-7aa01eb0b64a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:14.955352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.956032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.956316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.956593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:14.957352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:14.957660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:14.959076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:14.968695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 41/79] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:14.969528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:14.976034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:14.976757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:14.977646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:14.978068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.063455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.066558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.068680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.100214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425900ac-d843-4835-8f01-3f81ceccc998 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.122327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.154143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.155597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.155891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.156176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.172289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:15.184588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:15.185452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:15.186216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:15.186836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 42/80] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:15.190721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.197889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 39/81] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:15.203196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.331103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.334534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee2ec-a917-441c-88b4-89cd1144df9e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.334851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf64998-098f-4dc7-91ea-4194ddc14c12 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.379153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.379506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.380232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.380394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.380683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.380957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.381096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.381600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.382423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.382654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:15.383651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.384536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.385450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.390878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 40/82] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:15.390878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.406435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 43/83] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:15.407302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.447039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.497609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb50ef-45c1-4f6d-a575-904a0fae5589 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.525151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796abac-ae9d-40ac-851e-04c24bd38597 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.538381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.540162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.540613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.541036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.542234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:15.543147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.545253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.557196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 41/84] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:15.558641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.567399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.568350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.568747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.569104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.571036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.573053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.575806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 44/85] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:15.576988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.597039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.683457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0357-5bcf-45aa-85c4-0977dbf84a9f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.717785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317d116-3a89-42d4-8f20-1c50c4fe7623 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.720421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.721323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.722243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.723006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.723490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.764379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.765604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.765893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.766199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.767453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.768923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.778861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 45/86] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:15.778861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.814986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.816457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.852691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:15.916213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c9b91-a611-4beb-8f49-f3dc7c42954d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:15.924547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 42/87] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:15.929183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:15.967167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:15.968319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:15.968750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:15.969572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:15.970970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:15.973496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:15.975805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 46/88] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:15.977788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:16.029725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.036870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca001-3520-4ac7-b0e2-1e99cf622e8d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.070836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.076119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.076804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.077097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.077378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.078239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=de229b1cc5474a4893e26902c78ad7b6) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:16.078574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.080052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.090569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 43/89] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/role_assignments?user.id=de229b1cc5474a4893e26902c78ad7b6&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:16.091273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:16.098341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906ad4-c1ba-49cf-a63a-8ff7f7e034fb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.139924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.141013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.141505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.141993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.220805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.224928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.235682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8f7f8-4781-4c39-8ea9-cfc6aecce4ef None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.270532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.277579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.278719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.279199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.279674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.281168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.282958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.285009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 44/90] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:16 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:16.285978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:16.344998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 47/91] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:16.345930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:16.376991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.444664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5d6f-65e4-471d-8478-410f7fd0836b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.455824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb043-8bbc-47b5-990a-50cd3158b0fa None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.483879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.484882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.485405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.485885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.496847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.497724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.498018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.498298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.499558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=3d9602c060d644089af9ad7f45e2a55b) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:16.499679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.501273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.507632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 48/92] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:16 2022] GET /identity/v3/role_assignments?user.id=3d9602c060d644089af9ad7f45e2a55b&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:16.509024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:16.512847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.611618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.613145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.627566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2c4b-892e-4725-bcf4-e714e09119b1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.665555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.666631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.666946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.667226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.668552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.670035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.671867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 49/93] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:16 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:16.682011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:16.786060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.807255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:16.827494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a91f1-d990-44d6-976f-50f4b6f49820 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:16.866544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:16.868542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:16.869074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:16.869561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:16.870622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] RBAC: Adding query filter params (role.id=934aebd972524ff69425bd080d013143, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=de229b1cc5474a4893e26902c78ad7b6) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:16.871467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:16.873129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:16.879480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 50/94] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:16 2022] GET /identity/v3/role_assignments?user.id=de229b1cc5474a4893e26902c78ad7b6&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=934aebd972524ff69425bd080d013143 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:16.894018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 45/95] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:16.901200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:17.064096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbffeb-932d-4842-bc37-cb8b7d8023b5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:17.099889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fccc8a-ba56-4798-88fc-1399b5a3fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:17.100764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fccc8a-ba56-4798-88fc-1399b5a3fd6a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.101051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fccc8a-ba56-4798-88fc-1399b5a3fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.101327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fccc8a-ba56-4798-88fc-1399b5a3fd6a None admin] PATH_INFO: `/v3/projects/cf600c9ecc30464ab603c5e234c28dc8` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.103109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fccc8a-ba56-4798-88fc-1399b5a3fd6a None admin] RBAC: Authorizing `identity:get_project(project_id=cf600c9ecc30464ab603c5e234c28dc8)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:17.104601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fccc8a-ba56-4798-88fc-1399b5a3fd6a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:17.106397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 51/96] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:16 2022] GET /identity/v3/projects/cf600c9ecc30464ab603c5e234c28dc8 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:17.112346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:17.234409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83337-446c-4045-8f16-4aaa3f38e3e2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:17.280980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:17.281664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.281937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.282252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.283151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=cf600c9ecc30464ab603c5e234c28dc8, user.id=de229b1cc5474a4893e26902c78ad7b6) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:17.283466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:17.284957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87987d53-c6af-445b-8681-45de08cbe8af None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:17.295451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 46/97] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:17 2022] GET /identity/v3/role_assignments?user.id=de229b1cc5474a4893e26902c78ad7b6&scope.project.id=cf600c9ecc30464ab603c5e234c28dc8&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:17.345619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7cde-36ff-4c33-bc0c-941cf1ea3a17 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.345904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7cde-36ff-4c33-bc0c-941cf1ea3a17 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.346120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7cde-36ff-4c33-bc0c-941cf1ea3a17 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.347803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 52/98] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:17.353496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.353777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.354057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.375786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:17.377008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:17.402430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:17.410217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b3a29-6d5e-4dbd-bc4c-ef93210fe071 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.410217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b3a29-6d5e-4dbd-bc4c-ef93210fe071 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.410217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b3a29-6d5e-4dbd-bc4c-ef93210fe071 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.411495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 53/99] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:17.417729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.419158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.419158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.427309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:17.441086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:17.442333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:17.508102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 47/100] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:17.525404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 54/101] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:17.548773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:17.548993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:17.667919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92daa3f-667d-4050-89d8-7846ebb036cb None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:17.707820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:17.708665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.708953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.709231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.714551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:17.714551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:17.714881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 55/102] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:17.720533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:17.727568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:17.770875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5db0d-53fd-4646-90d5-2499cf60d787 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:17.845324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:17.846142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:17.846431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:17.846733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:17.859681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:17.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:17.869865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:17.870640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 48/103] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:17.876584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:17.922391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:17.948111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec5c02-6263-447a-b435-8db4a1cc4a7e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:18.015520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:18.016242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:18.016583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:18.016864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:18.017628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:18.019113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:18.064438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014045b7-0d47-49a3-b60c-53e99721a719 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:18.117993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 56/104] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:27:17 2022] POST /identity/v3/projects => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:18.123535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:18.124515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:18.125709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:18.125709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:18.126322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:18.126866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:18.128449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:18.145946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 49/105] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:18.152665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:18.240790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:18.310253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69cc9e-9849-4d1e-9206-1c3be7718c2f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:18.356518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:18.357468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:18.357765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:18.358043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] PATH_INFO: `/v3/users/98e4c86214b343de938a048f3ca0faa3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:18.374312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] RBAC: Authorizing `identity:get_user(user_id=98e4c86214b343de938a048f3ca0faa3)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:18.375849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:18.377881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 57/106] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:18 2022] GET /identity/v3/users/98e4c86214b343de938a048f3ca0faa3 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:18.383931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:18.501030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:18.527953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d02821-9893-45ab-8b30-335370b6f878 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:18.562937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:18.563605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:18.563899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:18.564186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:18.639165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:18.640642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:18.723772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:18.747563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 50/107] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:18.753215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:18.916442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de9b35-9764-4af9-b057-d5408c486f69 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:18.940864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:18.965000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f67fa-847b-4eb5-bbee-c6da1e0eabd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:18.965924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f67fa-847b-4eb5-bbee-c6da1e0eabd2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:18.966258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f67fa-847b-4eb5-bbee-c6da1e0eabd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:18.966536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f67fa-847b-4eb5-bbee-c6da1e0eabd2 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:18.971077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f67fa-847b-4eb5-bbee-c6da1e0eabd2 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:18.972849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f67fa-847b-4eb5-bbee-c6da1e0eabd2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:18.974927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 58/108] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:18 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:18.980491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:19.137852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703613ea-3259-4969-9c56-fac3046ab50f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:19.189285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:19.189952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.190236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.190511 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.191396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] RBAC: Adding query filter params (role.id=059406682d354fda8a52fbe50d88febc, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=98e4c86214b343de938a048f3ca0faa3) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:19.191707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:19.193159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632951e-e531-4d54-bf7d-bcf1ecaa025a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:19.203092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 51/109] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:18 2022] GET /identity/v3/role_assignments?user.id=98e4c86214b343de938a048f3ca0faa3&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=059406682d354fda8a52fbe50d88febc => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:19.566887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85cdcd-6874-485b-956e-ac37318b0ad2 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.567844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85cdcd-6874-485b-956e-ac37318b0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.568332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85cdcd-6874-485b-956e-ac37318b0ad2 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.570172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 59/110] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:19.575833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.576135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.576419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.606584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:19.607821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:19.615713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d50c9-e51b-43f3-8422-d64c1efa8d1e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.616258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d50c9-e51b-43f3-8422-d64c1efa8d1e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.616749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d50c9-e51b-43f3-8422-d64c1efa8d1e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.618997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 60/111] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:19.624006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4fa08-f8e6-41d6-9430-d8987c370211 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.624506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4fa08-f8e6-41d6-9430-d8987c370211 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.625009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4fa08-f8e6-41d6-9430-d8987c370211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.651623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:19.659707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3cd4fa08-f8e6-41d6-9430-d8987c370211 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:19.660921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3cd4fa08-f8e6-41d6-9430-d8987c370211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:19.697056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 52/112] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:19.732944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:19.808471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 61/113] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:19.830938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fcd19-6db4-4fb9-beea-d3d4e49fbc5d None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.831143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fcd19-6db4-4fb9-beea-d3d4e49fbc5d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.831622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fcd19-6db4-4fb9-beea-d3d4e49fbc5d None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.833463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 62/114] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:19.838911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.840313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.840840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:19.870737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:19.872282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:19.916970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b643eb-5b87-45c7-b4d2-f45f49772ec5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:19.978726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 63/115] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:19.980266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:19.989963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:19.990804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:19.991092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:19.991370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.019334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:20.027697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:20.028557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:20.029312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 53/116] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:20.030060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.037199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.102881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a7674-c3a4-4539-8f2c-cb758831dfc5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.131713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.139978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.144905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.144905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.144905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.153101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:20.164140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:20.165510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:20.166270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:20.168391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 64/117] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:20.168391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.276825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bdcc3-7abd-453c-9816-3aa721e950f3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.286310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.330309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51853f-cda7-4249-a59d-bfa4954c7067 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.333941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.334623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.334934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.335207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.335973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:20.336925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:20.338297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:20.358221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 65/118] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:20.359083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.389814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dadd3-e856-42b0-a65e-934a29d2945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.391057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dadd3-e856-42b0-a65e-934a29d2945f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.391345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dadd3-e856-42b0-a65e-934a29d2945f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.391625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dadd3-e856-42b0-a65e-934a29d2945f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.407163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dadd3-e856-42b0-a65e-934a29d2945f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-855dadd3-e856-42b0-a65e-934a29d2945f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:20.419046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:20.419899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:20.420769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 54/119] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:20.422112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e61a-772d-42cf-b78e-fff1b3b2489c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.422112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e61a-772d-42cf-b78e-fff1b3b2489c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.422112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e61a-772d-42cf-b78e-fff1b3b2489c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.423328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 55/120] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:20.424011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7e61a-772d-42cf-b78e-fff1b3b2489c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.483815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543996-c79b-4be9-94a9-418e8fdc2d5b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.519858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.520616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.520912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.521246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.522164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:20.522485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:20.524465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731dd81-9542-44aa-aba5-0ef3f55c9ba0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:20.533495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 66/121] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:20.534710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.535035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.535319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.553615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.554812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:20.556435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:20.565175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7e61a-772d-42cf-b78e-fff1b3b2489c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.578434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.605823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.606745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.607090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.607823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.609281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:20.611492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:20.613751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 56/122] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:20.615153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.638703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 67/123] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:20.639728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.747045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bdf23-cae4-4315-9d14-a9af42982865 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.778084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d1ef3-e969-4c55-bca1-bc86675db345 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.795784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.796765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.797261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.797758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.798861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:20.799412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:20.800990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:20.814963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 57/124] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:20.816266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.819248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.820225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.820555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.821226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.827036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:20.829437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:20.832262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 68/125] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:20.833223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:20.848541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.867297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:20.934303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8676030-0b2b-4cef-8985-d70eee52c6d9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.965419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1c74-e485-4e52-a3ca-2b2d8aec7234 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:20.978499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:20.979505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:20.979799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:20.980232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:20.981559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:20.983215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:20.985045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 58/126] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:20.990381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.006906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.008119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.008419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.009043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.022869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:21.033640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:21.034478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:21.035292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 69/127] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:21.040060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.093344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:21.105249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb35a47-c9f7-4797-91e5-aba98fee09d3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.143732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.144476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:21.146049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.146483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.146942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.148322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.150862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.154328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 59/128] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:20 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:21.154328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.167650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f6378-ac0e-468c-9eca-e716fccf9961 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.204472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.205865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.206367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.206878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.208462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.210223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.213429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 70/129] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:21 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:21.217305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.284055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6a274-8b57-487e-88a5-667e232c87fc None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.324832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a71f8-f311-4ae5-ab90-2e6b30e294cc None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.329202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.330223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.330615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.331047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/de229b1cc5474a4893e26902c78ad7b6/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.333242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] RBAC: Authorizing `identity:create_grant(project_id=19718448a5c043e99250c2caa2fe2ef9, user_id=de229b1cc5474a4893e26902c78ad7b6, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.335420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.364001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.364676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.365247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.366008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:21.366324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.368021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.376384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 71/130] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:21.377167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.393990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:21.414799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 60/131] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:21 2022] PUT /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/de229b1cc5474a4893e26902c78ad7b6/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:21.414799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.437895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:21.505381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f4267-d17c-4eed-93dd-8cb4fffe4425 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.549797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00992c-b26e-4dd8-afc0-c019db5db558 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.551675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8cb2e-11b8-4eda-8726-c506a4d56ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.552669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8cb2e-11b8-4eda-8726-c506a4d56ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.553827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8cb2e-11b8-4eda-8726-c506a4d56ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.553827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8cb2e-11b8-4eda-8726-c506a4d56ad4 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.554741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8cb2e-11b8-4eda-8726-c506a4d56ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.556944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8cb2e-11b8-4eda-8726-c506a4d56ad4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.562727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 72/132] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:21 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:21.562727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6bfe9-1281-4bc0-b3d9-1e4e70139831 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.562727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6bfe9-1281-4bc0-b3d9-1e4e70139831 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.562727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6bfe9-1281-4bc0-b3d9-1e4e70139831 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.562727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 73/133] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:21.563416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6bfe9-1281-4bc0-b3d9-1e4e70139831 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.602554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.603831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.604267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.604943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/3d9602c060d644089af9ad7f45e2a55b/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.608100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] RBAC: Authorizing `identity:create_grant(project_id=19718448a5c043e99250c2caa2fe2ef9, user_id=3d9602c060d644089af9ad7f45e2a55b, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.609746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.656077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:21.678220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6bfe9-1281-4bc0-b3d9-1e4e70139831 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.712620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb32ee-4eb8-4c32-be2e-18fe67043771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.713550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb32ee-4eb8-4c32-be2e-18fe67043771 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.713835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb32ee-4eb8-4c32-be2e-18fe67043771 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.714107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb32ee-4eb8-4c32-be2e-18fe67043771 None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.715394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb32ee-4eb8-4c32-be2e-18fe67043771 None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.716837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb32ee-4eb8-4c32-be2e-18fe67043771 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.723629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 74/134] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:21 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:21.723629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.723629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.723629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.733546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 61/135] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:21 2022] PUT /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/3d9602c060d644089af9ad7f45e2a55b/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:21.734879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.761430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:21.762675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:21.875648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:21.887227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 75/136] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:21.894740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:21.920275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f16e5-eb11-439d-94f3-6045755ac463 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:21.966791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5a5dd-5335-4216-93b9-c6b154e60d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:21.967695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5a5dd-5335-4216-93b9-c6b154e60d21 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:21.967991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5a5dd-5335-4216-93b9-c6b154e60d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:21.968272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5a5dd-5335-4216-93b9-c6b154e60d21 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/de229b1cc5474a4893e26902c78ad7b6/roles/934aebd972524ff69425bd080d013143` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:21.970657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5a5dd-5335-4216-93b9-c6b154e60d21 None admin] RBAC: Authorizing `identity:create_grant(project_id=19718448a5c043e99250c2caa2fe2ef9, user_id=de229b1cc5474a4893e26902c78ad7b6, role_id=934aebd972524ff69425bd080d013143)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:21.972142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5a5dd-5335-4216-93b9-c6b154e60d21 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:21.993929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:22.015950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721bdfd-0b56-4e2d-bf4f-9a47ad55dee3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:22.039142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 62/137] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:21 2022] PUT /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/de229b1cc5474a4893e26902c78ad7b6/roles/934aebd972524ff69425bd080d013143 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:22.040737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45abf-fd8d-43fa-b9cd-979da2e40a4e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.041416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45abf-fd8d-43fa-b9cd-979da2e40a4e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.041416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45abf-fd8d-43fa-b9cd-979da2e40a4e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.043113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 63/138] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:22.043868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45abf-fd8d-43fa-b9cd-979da2e40a4e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:22.083422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ba413-b987-41cf-aa7d-9fa3923331c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:22.084308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba413-b987-41cf-aa7d-9fa3923331c6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.084590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba413-b987-41cf-aa7d-9fa3923331c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.084867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba413-b987-41cf-aa7d-9fa3923331c6 None admin] PATH_INFO: `/v3/projects/cf600c9ecc30464ab603c5e234c28dc8` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.086854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ba413-b987-41cf-aa7d-9fa3923331c6 None admin] RBAC: Authorizing `identity:get_project(project_id=cf600c9ecc30464ab603c5e234c28dc8)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:22.088372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ba413-b987-41cf-aa7d-9fa3923331c6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:22.095121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 76/139] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:21 2022] GET /identity/v3/projects/cf600c9ecc30464ab603c5e234c28dc8 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:22.098275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.098560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.098869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.131443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:22.132678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:22.209500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 77/140] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:22.210401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:22.289486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45abf-fd8d-43fa-b9cd-979da2e40a4e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:22.297870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:22.321375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6fe51-c9aa-47d0-b129-ff428d341787 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:22.337311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:22.338397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.338782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.339136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.341082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:22.342823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:22.350193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 64/141] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:22.350193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:22.359169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:22.372066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:22.373311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.373594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.373867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] PATH_INFO: `/v3/projects/cf600c9ecc30464ab603c5e234c28dc8/users/de229b1cc5474a4893e26902c78ad7b6/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.382734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf600c9ecc30464ab603c5e234c28dc8, user_id=de229b1cc5474a4893e26902c78ad7b6, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:22.383769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:22.455275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 78/142] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:22 2022] PUT /identity/v3/projects/cf600c9ecc30464ab603c5e234c28dc8/users/de229b1cc5474a4893e26902c78ad7b6/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:22.460151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cf47-6d5f-48d8-8588-1b08ceef65f1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:22.463924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:22.532577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:22.533407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.533689 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.533965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.556225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:22.569460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:22.570411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:22.571601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 65/143] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:22.583526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:22.736356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aa799-bed2-4d6b-ad16-4769986e8232 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:22.763116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:22.845733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb2b7b-1473-488f-a86c-c7adb6595b08 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:22.863464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:22.864159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.864441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.864715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.865441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:22.866937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:22.880831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:22.893572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:22.894851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:22.895289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:22.895715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:22.896660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:22.897275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:22.899119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:22.909207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 66/144] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:22.919196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:23.032715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 79/145] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:22 2022] POST /identity/v3/users => generated 283 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:23.083913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4d44f-b463-41af-bc3f-7fded88f9dcb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:23.116541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:23.126335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:23.127599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:23.128034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:23.133507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] PATH_INFO: `/v3/users/98e4c86214b343de938a048f3ca0faa3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:23.133507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] RBAC: Authorizing `identity:get_user(user_id=98e4c86214b343de938a048f3ca0faa3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:23.133507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:23.135768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 67/146] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:22 2022] GET /identity/v3/users/98e4c86214b343de938a048f3ca0faa3 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:23.142726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:23.314883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7979e-f10d-49f7-a111-d36c76d72c8c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:23.357739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f0960-a221-43a7-9b1e-61dbc0f0e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:23.358621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0960-a221-43a7-9b1e-61dbc0f0e03a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:23.358925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0960-a221-43a7-9b1e-61dbc0f0e03a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:23.359206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f0960-a221-43a7-9b1e-61dbc0f0e03a None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:23.360439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0960-a221-43a7-9b1e-61dbc0f0e03a None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:23.361920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f0960-a221-43a7-9b1e-61dbc0f0e03a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:23.363682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 80/147] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:23 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:23.369849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:23.497589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32582b5c-9a8d-4ab2-8328-516ea0953247 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:23.543728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd67bc3-65b7-4efe-b87d-46481f5019fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:23.545034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd67bc3-65b7-4efe-b87d-46481f5019fe None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:23.545513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd67bc3-65b7-4efe-b87d-46481f5019fe None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:23.545983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd67bc3-65b7-4efe-b87d-46481f5019fe None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/98e4c86214b343de938a048f3ca0faa3/roles/059406682d354fda8a52fbe50d88febc` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:23.552101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd67bc3-65b7-4efe-b87d-46481f5019fe None admin] RBAC: Authorizing `identity:create_grant(project_id=19718448a5c043e99250c2caa2fe2ef9, user_id=98e4c86214b343de938a048f3ca0faa3, role_id=059406682d354fda8a52fbe50d88febc)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:23.553941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd67bc3-65b7-4efe-b87d-46481f5019fe None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:23.631703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 68/148] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:23 2022] PUT /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9/users/98e4c86214b343de938a048f3ca0faa3/roles/059406682d354fda8a52fbe50d88febc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:23.888648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2f51-28f2-48a9-8b85-f39816b15fb1 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:23.889115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2f51-28f2-48a9-8b85-f39816b15fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:23.889115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2f51-28f2-48a9-8b85-f39816b15fb1 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:23.890501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 81/149] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:23.896495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:23.896793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:23.897077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:23.920911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:23.922113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:23.985954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:24.002947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 69/150] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:24.028051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2f51-28f2-48a9-8b85-f39816b15fb1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:24.095131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:24.147926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2f51-28f2-48a9-8b85-f39816b15fb1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:24.193197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:24.194003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:24.194288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:24.194561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:24.209522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:24.218156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:24.219053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:24.219848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 82/151] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:24.227698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:24.344144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f409c-32cd-4ade-b308-2be412cbdb10 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:24.382984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:24.384375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:24.384702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:24.384980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:24.385751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:24.386057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:24.387482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:24.396983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 70/152] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:24.403277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:24.554315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3e81-a35b-4ba8-8c30-b921df4364d8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:24.582351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:24.598261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:24.599174 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:24.599459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:24.599737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:24.603529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:24.603529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:24.604450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 83/153] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:24 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:24.609931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:24.697490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:24.779520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f42147-20cd-4e77-a712-45877214fb2f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:24.826887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:24.827558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:24.827846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:24.828128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:24.908302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:24.909771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:24.961632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:25.025531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 71/154] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:25.031235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:25.194643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7987-264f-4e8a-9158-469cd849b7a3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:25.246752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901eeef-a87f-435c-9157-f070aeec7f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:25.247976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901eeef-a87f-435c-9157-f070aeec7f3d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.248495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901eeef-a87f-435c-9157-f070aeec7f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.248968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901eeef-a87f-435c-9157-f070aeec7f3d None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.255491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901eeef-a87f-435c-9157-f070aeec7f3d None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:25.257220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901eeef-a87f-435c-9157-f070aeec7f3d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:25.259934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 84/155] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:25 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:25.265849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:25.414311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f750a-4ca1-4f2d-9565-14c489c2c863 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:25.453967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:25.454647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.454979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.455257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.456116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=de229b1cc5474a4893e26902c78ad7b6) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:25.456430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:25.457898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50e7a0-a484-4e7c-8ae8-1188d427383d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:25.467810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 72/156] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:25 2022] GET /identity/v3/role_assignments?user.id=de229b1cc5474a4893e26902c78ad7b6&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:25.476446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd636-538c-473e-a144-54ec1004d329 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.477764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd636-538c-473e-a144-54ec1004d329 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.478252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd636-538c-473e-a144-54ec1004d329 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.479966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 85/157] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:25.485877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c881-0c04-4bfb-b4d2-0e7a177b9d0c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.486161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c881-0c04-4bfb-b4d2-0e7a177b9d0c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.486444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c881-0c04-4bfb-b4d2-0e7a177b9d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.511507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-26d9c881-0c04-4bfb-b4d2-0e7a177b9d0c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:25.512658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-26d9c881-0c04-4bfb-b4d2-0e7a177b9d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:25.521316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:25.601249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 73/158] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:25.658214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd636-538c-473e-a144-54ec1004d329 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:25.676989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f6eb0-fee1-43ec-acb0-9cdd3f555d3b None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.677317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f6eb0-fee1-43ec-acb0-9cdd3f555d3b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.677552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f6eb0-fee1-43ec-acb0-9cdd3f555d3b None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.679142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 74/159] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:25.685637 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.685937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.686193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.731771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:25.732982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:25.733368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:25.824660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd636-538c-473e-a144-54ec1004d329 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:25.881092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 75/160] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 10:27:25.892294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:25.893121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:25.893410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:25.893689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:25.910410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:25.919269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:25.920417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:25.921347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 86/161] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:25.927916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:25.948257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.081278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:26.119641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ec20-7f71-4e22-955b-2cc856045b0e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.142578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f61521-f222-4c09-b052-e6a62b85d62a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.147827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:26.171478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9300-6bc3-4d43-b562-84971ece6c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:26.172708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9300-6bc3-4d43-b562-84971ece6c2d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.173187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9300-6bc3-4d43-b562-84971ece6c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.173654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9300-6bc3-4d43-b562-84971ece6c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.188120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9300-6bc3-4d43-b562-84971ece6c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-263f9300-6bc3-4d43-b562-84971ece6c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:26.197773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:26.198631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:26.199470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:26.202115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 87/162] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:26.203709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c440-7963-4912-814a-ca74fd888602 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.204192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c440-7963-4912-814a-ca74fd888602 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.204675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c440-7963-4912-814a-ca74fd888602 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.206357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 88/163] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:26.210043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c440-7963-4912-814a-ca74fd888602 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.226239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:26.227081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.227371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.227645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.228416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:26.228743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:26.230122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd06a7-f859-4b13-8fd0-2b39dfc269d8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:26.247109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 76/164] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:26.248570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.252288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.252288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.279740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:26.280941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:26.333112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c440-7963-4912-814a-ca74fd888602 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.371286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:26.372535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.373028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.373499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.374445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:26.375006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:26.376743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:26.387628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 89/165] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:26.389106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.423370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 77/166] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:26.423370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.443193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:26.525350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e816da-9a1e-4406-802d-c230e452d639 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.563370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:26.564658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.565131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.565612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.567193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:26.568904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:26.571073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 90/167] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:26 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:26.572205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.595774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:26.682607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab97d9-edbe-4dd8-86d6-7cf6cdae9fd4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.690709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:26.700643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c593655-99e1-4de4-8d7f-483ad9a91817 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.733154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:26.736102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.736613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.737084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.758566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:26.767698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:26.768827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:26.769326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:26.769809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] PATH_INFO: `/v3/users/3d9602c060d644089af9ad7f45e2a55b` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:26.771265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9602c060d644089af9ad7f45e2a55b)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:26.776173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:26.777041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:26.777812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:26.779907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:26.781977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 78/168] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:26 2022] GET /identity/v3/users/3d9602c060d644089af9ad7f45e2a55b => generated 247 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:26.783202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.786964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 91/169] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:26.791594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:26.986558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e7824-6d61-4432-9f30-a812a22e9d42 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:26.987978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d17d7-3d6a-417b-abdf-80b694c63339 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:27.026724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.026724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.026724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.026724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.048077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:27.067843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:27.068166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f5b5b-8db9-47a0-a613-9a73788e32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.068998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5b5b-8db9-47a0-a613-9a73788e32cc None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.069454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5b5b-8db9-47a0-a613-9a73788e32cc None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.069872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5b5b-8db9-47a0-a613-9a73788e32cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.110821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.112758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.161037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f5b5b-8db9-47a0-a613-9a73788e32cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.162818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f5b5b-8db9-47a0-a613-9a73788e32cc None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.258838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 92/170] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:27.258838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.284313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 79/171] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:27.290712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f588d-6eb6-47f7-8a58-adb45b1d89ef None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.295544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f588d-6eb6-47f7-8a58-adb45b1d89ef None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.295985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f588d-6eb6-47f7-8a58-adb45b1d89ef None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.297521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 80/172] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:27.298388 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f588d-6eb6-47f7-8a58-adb45b1d89ef None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.366184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:27.379415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:27.431181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3226f-2a0b-4cbe-b8fe-1001607c2910 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:27.495403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f588d-6eb6-47f7-8a58-adb45b1d89ef None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:27.498831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.499508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.499913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.500192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.500962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:27.501272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.502666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749ae4a-c547-465b-81c4-21e4e71c199a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.512840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 93/173] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:27.513950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e90c0-a263-436c-8d2a-ee6140590256 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.514236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e90c0-a263-436c-8d2a-ee6140590256 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.514511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e90c0-a263-436c-8d2a-ee6140590256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.532570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a83e90c0-a263-436c-8d2a-ee6140590256 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:27.533977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a83e90c0-a263-436c-8d2a-ee6140590256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:27.540339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.542150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.542661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.543170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.545071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.547469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.550162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 81/174] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:27.551302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.616690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 94/175] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:27.618316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea855a4-5897-4075-8cd7-1e382dd6188e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.618614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea855a4-5897-4075-8cd7-1e382dd6188e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.618939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea855a4-5897-4075-8cd7-1e382dd6188e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.620467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 95/176] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:27.624662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea855a4-5897-4075-8cd7-1e382dd6188e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.681935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:27.685124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009f740-841c-4c11-a12c-3365bd74c9b7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:27.700899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:27.720043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.720924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.721205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.721478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.723075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.725498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.728530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 82/177] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:27.732573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.756344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea855a4-5897-4075-8cd7-1e382dd6188e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:27.800511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63016-b147-449d-be10-90e0350b2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.802006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63016-b147-449d-be10-90e0350b2e17 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.802498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63016-b147-449d-be10-90e0350b2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.803001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63016-b147-449d-be10-90e0350b2e17 None admin] PATH_INFO: `/v3/users/de229b1cc5474a4893e26902c78ad7b6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.805423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63016-b147-449d-be10-90e0350b2e17 None admin] RBAC: Authorizing `identity:get_user(user_id=de229b1cc5474a4893e26902c78ad7b6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.807601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63016-b147-449d-be10-90e0350b2e17 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.810533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 96/178] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/users/de229b1cc5474a4893e26902c78ad7b6 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:27.812561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.813077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.813731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.835021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:27.837171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:27.855357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569937-f2b3-42e5-86c8-048f7e243ae8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:27.900161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:27.901160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:27.901636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:27.902097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:27.903696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=3d9602c060d644089af9ad7f45e2a55b) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:27.904321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:27.906440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:27.914543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 83/179] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/role_assignments?user.id=3d9602c060d644089af9ad7f45e2a55b&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:27.915554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.930745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 97/180] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:27.930745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:27.975388 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.066833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030d208-7742-465a-bc43-24e7590b5235 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.072585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.109060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.110198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.110722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.111187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.124399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:28.132829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:28.133807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:28.134578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:28.135668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 84/181] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:28.136506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.141992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808672c-71cb-4bc6-95d1-f18231d902e3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.181250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.181919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.182207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.182488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.183392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] RBAC: Adding query filter params (role.id=934aebd972524ff69425bd080d013143, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=de229b1cc5474a4893e26902c78ad7b6) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:28.183714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.185178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.191887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 98/182] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:27 2022] GET /identity/v3/role_assignments?user.id=de229b1cc5474a4893e26902c78ad7b6&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=934aebd972524ff69425bd080d013143 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:28.192521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.256054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.266263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee645-511b-4c8e-9f0c-3351bfa41cba None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.305992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.307106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.307347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.307698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.332703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8270b4-cf2e-437f-a39b-6ca6414321f4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.356975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.373651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59da18-5053-4f6f-8b7c-85b84d44ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.374454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59da18-5053-4f6f-8b7c-85b84d44ea67 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.374764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59da18-5053-4f6f-8b7c-85b84d44ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.375043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59da18-5053-4f6f-8b7c-85b84d44ea67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.386279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59da18-5053-4f6f-8b7c-85b84d44ea67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-fe59da18-5053-4f6f-8b7c-85b84d44ea67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:28.394897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:28.395758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:28.396559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:28.397170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.398287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.398609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 99/183] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:28.400082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98146-013c-4e1d-bfa7-7ff1a00044d0 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.400235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98146-013c-4e1d-bfa7-7ff1a00044d0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.401072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98146-013c-4e1d-bfa7-7ff1a00044d0 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.401998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 100/184] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:28.403124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92414-0e4c-4040-b666-efee46b9e3b7 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.403408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92414-0e4c-4040-b666-efee46b9e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.403680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92414-0e4c-4040-b666-efee46b9e3b7 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.405049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 101/185] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:28.405740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92414-0e4c-4040-b666-efee46b9e3b7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.498048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.507387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 85/186] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:28.513261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.515477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92414-0e4c-4040-b666-efee46b9e3b7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.549026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.549724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.550006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.550282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.551064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:28.551373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.552752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25dc29-a713-400a-a55c-060b9248778b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.561910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 102/187] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:28.562891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133d33-adea-45d9-a797-7baaf5c17703 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.563180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133d33-adea-45d9-a797-7baaf5c17703 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.563452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133d33-adea-45d9-a797-7baaf5c17703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.579206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-05133d33-adea-45d9-a797-7baaf5c17703 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:28.580398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-05133d33-adea-45d9-a797-7baaf5c17703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:28.615315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.620015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0789-7e36-4e35-bf5a-2319c158a85a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.647773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 103/188] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:28.649147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.649435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.649713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.653784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.654454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.654760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.655036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.655784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:28.656092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.657472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.666659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 86/189] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:28.667747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.674185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:28.675412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:28.725403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.741868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 104/190] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:28.743887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.771511 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329deb2-446f-42cc-afd0-8e38c0d03d5a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.808582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.809447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.809729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.810002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] PATH_INFO: `/v3/projects/cf600c9ecc30464ab603c5e234c28dc8` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.811273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] RBAC: Authorizing `identity:get_project(project_id=cf600c9ecc30464ab603c5e234c28dc8)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.812702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.814399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 87/191] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/projects/cf600c9ecc30464ab603c5e234c28dc8 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:28.815300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.844592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9495a4-e2d3-4c18-9d31-98f6596b0879 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.846299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.879131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.879932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.880209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.880478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] PATH_INFO: `/v3/users/98e4c86214b343de938a048f3ca0faa3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.881653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] RBAC: Authorizing `identity:get_user(user_id=98e4c86214b343de938a048f3ca0faa3)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.883670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.885292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 105/192] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/users/98e4c86214b343de938a048f3ca0faa3 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:28.889848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.922301 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fa0f-52f3-43ea-b84b-366a77c077fc None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:28.943340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:28.954920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:28.955706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:28.955988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:28.956298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:28.957508 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:28.958967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:28.960608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 88/193] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:28.962109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:28.988830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc611-3b17-4211-a117-24e59a5eadc6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.023041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.025366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.025647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.025919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] PATH_INFO: `/v3/users/9f6984483e63403eb4ff215649b61f60` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.039006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] RBAC: Authorizing `identity:get_user(user_id=9f6984483e63403eb4ff215649b61f60)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.040482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.042142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 106/194] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/users/9f6984483e63403eb4ff215649b61f60 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:29.042926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.065447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4e48-f902-447d-a3fc-11ffaa64fb32 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.070234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.099872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.100728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.101015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.101289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.111727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:29.119939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:29.120991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:29.121940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 89/195] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:29.122672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.147451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7a0d0-34bd-4e94-a1a6-56dea23e7e5d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.171551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.181461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.182193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.182482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.182790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.183640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=cf600c9ecc30464ab603c5e234c28dc8, user.id=de229b1cc5474a4893e26902c78ad7b6) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:29.183963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.185421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.191248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 107/196] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/role_assignments?user.id=de229b1cc5474a4893e26902c78ad7b6&scope.project.id=cf600c9ecc30464ab603c5e234c28dc8&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:29.192013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.228466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60333228-4d24-49a7-afff-f174fce3b89c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.270650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.271476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.271659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.271958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.299484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.309767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d56ed-118c-46a4-bd97-96f7f7410d57 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.349663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.351134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.351664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.352243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.353057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.353057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.353416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.354305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.405826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.420909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 108/197] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:29 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:29.421545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.474748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 90/198] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:29.476139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.542613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935372f-86f5-4815-a1be-ae13e2834264 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.582485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.583296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.583584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.583864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.603678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9917910-3171-4dc7-939a-13a576b34caa None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.604070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.647982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.649312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.649601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.650017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.650880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:29.651188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.652573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.662143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 91/199] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:29.663767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.676925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.678825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.684269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.803932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3af6-242e-4452-9de2-5e49199cfe97 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.810515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 109/200] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:29.811458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.842479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.843768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.844255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.844729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.846212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:29.848181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:29.850414 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 92/201] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:29.851398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:29.874286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.939213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:29.945291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4c50c-6f5e-4064-afcf-9f45266f051e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.963680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cddd3-20fc-44b1-aee3-2fc5ee99cf65 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:29.994633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:29.996378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:29.997095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:29.997514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] PATH_INFO: `/v3/users/9f6984483e63403eb4ff215649b61f60` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:29.999204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6984483e63403eb4ff215649b61f60)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.000907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.001079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:30.002048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:30.002430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:30.002849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:30.003843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 110/202] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/users/9f6984483e63403eb4ff215649b61f60 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:30.004810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:30.009404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.010864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.012837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 93/203] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:29 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:30.013690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:30.125226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb453ec-74eb-499b-befe-55f1fddba351 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:30.138966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c4ee6-c4be-40bb-852d-4a8e70cb2c53 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:30.162129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:30.165001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:30.165668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:30.165952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:30.166228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:30.185999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:30.186882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:30.187164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:30.187437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:30.188322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] RBAC: Adding query filter params (role.id=059406682d354fda8a52fbe50d88febc, scope.project.id=19718448a5c043e99250c2caa2fe2ef9, user.id=98e4c86214b343de938a048f3ca0faa3) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:30.188629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.189142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:30.190131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.196534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 111/204] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:30 2022] GET /identity/v3/role_assignments?user.id=98e4c86214b343de938a048f3ca0faa3&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=059406682d354fda8a52fbe50d88febc => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:30.197404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:30.259360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.262127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.314295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e42f2-6762-40a3-82ac-baa79e6ebd36 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:30.353485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:30.354232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:30.354478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:30.354808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:30.355662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=9f6984483e63403eb4ff215649b61f60) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:30.355975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.357489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.363543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 112/205] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:30 2022] GET /identity/v3/role_assignments?user.id=9f6984483e63403eb4ff215649b61f60&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:30.397622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 94/206] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:30.406843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:30.485197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:30.552130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717465a-1333-423d-9e3e-0e507cad131a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:30.592277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054121f2-72d1-4e0b-b0a5-a1eb83c1c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:30.593198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054121f2-72d1-4e0b-b0a5-a1eb83c1c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:30.593491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054121f2-72d1-4e0b-b0a5-a1eb83c1c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:30.593769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054121f2-72d1-4e0b-b0a5-a1eb83c1c1a8 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:30.594998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054121f2-72d1-4e0b-b0a5-a1eb83c1c1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.596471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054121f2-72d1-4e0b-b0a5-a1eb83c1c1a8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.598811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 113/207] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:30 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:30.606190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:30.663911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:30.723668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bb29-582f-45d0-8519-1ff22d2408ee None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:30.766893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:30.767485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:30.767767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:30.768040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:30.768892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] RBAC: Adding query filter params (role.id=934aebd972524ff69425bd080d013143, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=9f6984483e63403eb4ff215649b61f60) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:30.769201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:30.770640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93342acb-32e0-42d6-b125-fb9bc91f3f49 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:30.778749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 95/208] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:30 2022] GET /identity/v3/role_assignments?user.id=9f6984483e63403eb4ff215649b61f60&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=934aebd972524ff69425bd080d013143 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:31.759123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3492a-7eaa-47dd-85eb-293eda90a59b None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:31.759633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3492a-7eaa-47dd-85eb-293eda90a59b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:31.759709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3492a-7eaa-47dd-85eb-293eda90a59b None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:31.761344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 114/209] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:31.766841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:31.767234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:31.767399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:31.787738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:31.788995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:31.797091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a97bb-6025-4c72-a69b-ade049bb8482 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:31.797383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a97bb-6025-4c72-a69b-ade049bb8482 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:31.797668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a97bb-6025-4c72-a69b-ade049bb8482 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:31.799217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 115/210] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:31.803900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:31.804193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:31.804477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:31.822508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:31.823863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:31.865432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 96/211] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:31.889524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:31.899054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 116/212] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:31.923819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:31.940648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:31.995052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.000491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd898b-ee15-4631-95e9-51bfa711f566 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.026018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f853b43-1bea-40cc-bfac-fd57cc37f67a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.036842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.037752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.038045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.038326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.049971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:32.059317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:32.060424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:32.061319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 97/213] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:32.064398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.065217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.065506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.065785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.067400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:32.069051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:32.071668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.071782 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 117/214] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:32.079602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.177418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f645-a2ae-4cec-97d5-a9e66c5c4079 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.179425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.198373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d5f47-b069-4858-84d1-e1860a54aff9 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.214645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.218859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.219960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.220252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.220534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.221589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:32.221903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:32.224039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:32.235629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 98/215] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:32.240785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.245098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.245978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.246440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.246955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.247850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:32.249472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:32.338983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 118/216] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:32 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:32.364331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca5730-00b5-4576-aa91-d2b390866e4b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.405332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430f696-48d5-42af-a8dd-c01a288b1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.406440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f696-48d5-42af-a8dd-c01a288b1b73 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.406762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f696-48d5-42af-a8dd-c01a288b1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.407048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f696-48d5-42af-a8dd-c01a288b1b73 None admin] PATH_INFO: `/v3/users/5281ce03bb2c49e3a20d975f53b183bf` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.425489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f696-48d5-42af-a8dd-c01a288b1b73 None admin] RBAC: Authorizing `identity:get_user(user_id=5281ce03bb2c49e3a20d975f53b183bf)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:32.427307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f696-48d5-42af-a8dd-c01a288b1b73 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:32.429182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 99/217] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/users/5281ce03bb2c49e3a20d975f53b183bf => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:32.435922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.533967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450076f-3ffd-49cf-aeb8-658f54b9a0d0 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.534228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450076f-3ffd-49cf-aeb8-658f54b9a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.536519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450076f-3ffd-49cf-aeb8-658f54b9a0d0 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.536519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 100/218] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:32.543635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.543996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.544280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.557452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8193a1b-c940-42f7-b33c-d6e8fe9e5779 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.563643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:32.564837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:32.586238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.607305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.607906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.608187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.608462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.661451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 101/219] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:32.667784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.687954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.710590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:32.712843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:32.831877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 119/220] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:32.840341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.841986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e775-b10c-4310-8a30-4512ef970839 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:32.919198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2e266-c8e5-484a-9131-eb2287bcad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:32.919932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2e266-c8e5-484a-9131-eb2287bcad8c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.920213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2e266-c8e5-484a-9131-eb2287bcad8c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.920489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2e266-c8e5-484a-9131-eb2287bcad8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.942618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2e266-c8e5-484a-9131-eb2287bcad8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-01d2e266-c8e5-484a-9131-eb2287bcad8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:32.954473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:32.955380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:32.956157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:32.957215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:32.959874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 102/221] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:32.961903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663bb88-251b-4bd3-8103-aee75c74ee45 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:32.962343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663bb88-251b-4bd3-8103-aee75c74ee45 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:32.962934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663bb88-251b-4bd3-8103-aee75c74ee45 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:32.964485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 103/222] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:32.968589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663bb88-251b-4bd3-8103-aee75c74ee45 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:32.984383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:33.012906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f1f91-e742-4111-a75e-01a361caaeee None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.061401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8005c-57ee-4508-938f-2301e0a091e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.062624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8005c-57ee-4508-938f-2301e0a091e4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.063173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8005c-57ee-4508-938f-2301e0a091e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.063620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8005c-57ee-4508-938f-2301e0a091e4 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.065118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8005c-57ee-4508-938f-2301e0a091e4 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:33.067400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8005c-57ee-4508-938f-2301e0a091e4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:33.071094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 120/223] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:33.072761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.073225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.074216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.096606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:33.098056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663bb88-251b-4bd3-8103-aee75c74ee45 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.098621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:33.143251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.144097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.144387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.144678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.145506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:33.145824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:33.147327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:33.156316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 104/224] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:33.157348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.186670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 121/225] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:33.188392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.252152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:33.272076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:33.279066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de5703-07b5-49c6-bc6b-1b2d4f114426 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.349795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5376-4430-46b9-91d5-cf628686ae51 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.351664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.353936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.354445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.354939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.355981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=5281ce03bb2c49e3a20d975f53b183bf) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:33.356489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:33.358536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:33.366459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 105/226] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:33 2022] GET /identity/v3/role_assignments?user.id=5281ce03bb2c49e3a20d975f53b183bf&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:33.367889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.406438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.407440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.407725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.407998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] PATH_INFO: `/v3/users/9f6984483e63403eb4ff215649b61f60` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.409246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6984483e63403eb4ff215649b61f60)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:33.412542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:33.418015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 122/227] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:33 2022] GET /identity/v3/users/9f6984483e63403eb4ff215649b61f60 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:33.423880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.561022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917468c-da72-407c-892e-d45b38f7e93e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.608870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c576e0-bb48-4cd6-a4af-b4d383dc04f7 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.628391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.629213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.629500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.629780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.643976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:33.651555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:33.668294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:33.669199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:33.669998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 106/228] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:33.670648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:33.678604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.687703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.688657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.688947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.689229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.690493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:33.692076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:33.694183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 123/229] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:33 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:33.700981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.789666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9a26-e1f6-4331-a777-d5a9fea2dad2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.828099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:33.829165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:33.829599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:33.830037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:33.831045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:33.831551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:33.833207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:33.842749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 107/230] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:33.849955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:33.927422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3bec3-a51e-4e65-b379-be2e21b22ad4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:33.963370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:34.000171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:34.001071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.001356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.001634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732/users/9f6984483e63403eb4ff215649b61f60/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.005706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] RBAC: Authorizing `identity:create_grant(project_id=83372225aaa24948a3e30d4aa887c732, user_id=9f6984483e63403eb4ff215649b61f60, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:34.007220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:34.027079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c1f7-cab0-49b8-bf87-b5a2ba1c8f50 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:34.061953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:34.062931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.063220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.063548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] PATH_INFO: `/v3/users/9f6984483e63403eb4ff215649b61f60` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.064820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6984483e63403eb4ff215649b61f60)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:34.066291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:34.068413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 108/231] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:33 2022] GET /identity/v3/users/9f6984483e63403eb4ff215649b61f60 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:34.075824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:34.089554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 124/232] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:33 2022] PUT /identity/v3/projects/83372225aaa24948a3e30d4aa887c732/users/9f6984483e63403eb4ff215649b61f60/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:34.233532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108fed-57a6-472a-9da5-ff8865bfb3f7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:34.272384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:34.281397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34054-704c-43ad-9ac1-e8b12ad1c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:34.282592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34054-704c-43ad-9ac1-e8b12ad1c54f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.283081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34054-704c-43ad-9ac1-e8b12ad1c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.283533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34054-704c-43ad-9ac1-e8b12ad1c54f None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.285000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34054-704c-43ad-9ac1-e8b12ad1c54f None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:34.286632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34054-704c-43ad-9ac1-e8b12ad1c54f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:34.293380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 109/233] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:34 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:34.294956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:34.367998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:34.421643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4754a-60e8-478e-af9f-a8a9fc489973 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:34.470791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49caf56-b44e-4b7e-8526-24c64519fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:34.472147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caf56-b44e-4b7e-8526-24c64519fa2d None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.472679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caf56-b44e-4b7e-8526-24c64519fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.472960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caf56-b44e-4b7e-8526-24c64519fa2d None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732/users/9f6984483e63403eb4ff215649b61f60/roles/934aebd972524ff69425bd080d013143` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.475256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49caf56-b44e-4b7e-8526-24c64519fa2d None admin] RBAC: Authorizing `identity:create_grant(project_id=83372225aaa24948a3e30d4aa887c732, user_id=9f6984483e63403eb4ff215649b61f60, role_id=934aebd972524ff69425bd080d013143)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:34.477315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49caf56-b44e-4b7e-8526-24c64519fa2d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:34.603884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 125/234] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:34 2022] PUT /identity/v3/projects/83372225aaa24948a3e30d4aa887c732/users/9f6984483e63403eb4ff215649b61f60/roles/934aebd972524ff69425bd080d013143 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:34.821640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278cd42-b554-4781-a970-54d302fde228 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.822296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278cd42-b554-4781-a970-54d302fde228 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.822816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278cd42-b554-4781-a970-54d302fde228 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.824744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 110/235] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:34.830681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.831251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.831750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.858944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:34.860507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:34.897885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5c223-c53c-46a2-9592-18f96c78b565 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.898386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5c223-c53c-46a2-9592-18f96c78b565 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.898608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5c223-c53c-46a2-9592-18f96c78b565 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.900071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 111/236] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:34.905416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7a68-c69a-4238-9776-8720049f45db None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:34.905984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7a68-c69a-4238-9776-8720049f45db None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:34.906483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7a68-c69a-4238-9776-8720049f45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:34.924354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-390f7a68-c69a-4238-9776-8720049f45db None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:34.925882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-390f7a68-c69a-4238-9776-8720049f45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:34.959297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 126/237] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:34.987738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:35.000782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 112/238] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:35.026068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7a68-c69a-4238-9776-8720049f45db None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:35.047847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:35.125405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398974-e749-4db9-9cc4-be456ad005b0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:35.172832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7a68-c69a-4238-9776-8720049f45db None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:35.189973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:35.190861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.191144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.191420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.192643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:35.194102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:35.203142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 127/239] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:35.206404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:35.231227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:35.241347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:35.242998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.243411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.243693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.254368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:35.263066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:35.263940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:35.264723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:35.265322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 113/240] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:35.275973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:35.395961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994437-e46e-41af-928a-29a58d3b816d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:35.417166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:35.437052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:35.437732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.437839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673ce97-5a57-4f10-89b2-b427ebd26fe8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:35.438027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.438289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.439067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:35.441680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:35.479865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:35.480608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.480903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.481179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.481949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:35.482260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:35.483761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:35.494060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 114/241] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:35.499575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:35.536945 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 128/242] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:35 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:35.558870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:35.618461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2426405-1c73-483a-bc2d-a4354bc3db43 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:35.656754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde15d8-be4c-47db-beed-c58c967e01b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:35.657571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde15d8-be4c-47db-beed-c58c967e01b7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.657854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde15d8-be4c-47db-beed-c58c967e01b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.658129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde15d8-be4c-47db-beed-c58c967e01b7 None admin] PATH_INFO: `/v3/users/f653c6ce0e7b4832aec99320a6d6620c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.674293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde15d8-be4c-47db-beed-c58c967e01b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f653c6ce0e7b4832aec99320a6d6620c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:35.675838 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde15d8-be4c-47db-beed-c58c967e01b7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:35.677835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 115/243] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:35 2022] GET /identity/v3/users/f653c6ce0e7b4832aec99320a6d6620c => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:35.684804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:35.817363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62df7b-33d4-448b-a115-1830ee8d1c16 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:35.853785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:35.854453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.854811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.855098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.900668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:35.904033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334ca7c-3d72-4b4e-83d8-9578f74ed6b1 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.904469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334ca7c-3d72-4b4e-83d8-9578f74ed6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.904653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334ca7c-3d72-4b4e-83d8-9578f74ed6b1 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.905972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 116/244] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:35.911226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:35.911768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:35.912227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:35.931784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:35.932604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:35.933546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:35.934289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:36.016786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 117/245] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:36.043027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.053840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 129/246] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:36.059302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.090896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:36.176694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:36.187419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a123b-73b8-4ee1-8a48-447c59f5e00c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:36.216700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d7a7a-b983-4875-adeb-a8925b5118fb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:36.241146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:36.242887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:36.243921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:36.244856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:36.262136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:36.268669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:36.269732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:36.270192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:36.270619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:36.271959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:36.273032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:36.274196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:36.275188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:36.276104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 118/247] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:36.276984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:36.279240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 130/248] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:36 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:36.281811 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.286766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.401651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:36.408631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644560f-6c2a-4842-829a-f16f6d44c764 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:36.420289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac7be-ba2f-4387-a2f7-c7f5a7684f24 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:36.457261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:36.458238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:36.458520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:36.458823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:36.459946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:36.460268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:36.462791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:36.464465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:36.465456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:36.465923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:36.466377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:36.467451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] RBAC: Adding query filter params (role.id=059406682d354fda8a52fbe50d88febc, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=f653c6ce0e7b4832aec99320a6d6620c) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:36.467971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:36.469804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:36.472362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 119/249] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:36.479163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.480956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 131/250] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:36 2022] GET /identity/v3/role_assignments?user.id=f653c6ce0e7b4832aec99320a6d6620c&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=059406682d354fda8a52fbe50d88febc => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:36.589623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd140fb-4a15-4887-acac-f38b8735978c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:36.627849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:36.629023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:36.629454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:36.629874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] PATH_INFO: `/v3/users/5281ce03bb2c49e3a20d975f53b183bf` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:36.631276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=5281ce03bb2c49e3a20d975f53b183bf)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:36.632931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:36.635183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 120/251] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:36 2022] GET /identity/v3/users/5281ce03bb2c49e3a20d975f53b183bf => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:36.641903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.657473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:36.791367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75478f2-a28a-4c92-bb56-141519ddc020 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:36.832116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401a86-b982-45b5-a360-773577bfd8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:36.833054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401a86-b982-45b5-a360-773577bfd8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:36.833374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401a86-b982-45b5-a360-773577bfd8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:36.833660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401a86-b982-45b5-a360-773577bfd8a9 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:36.834903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14401a86-b982-45b5-a360-773577bfd8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:36.836690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14401a86-b982-45b5-a360-773577bfd8a9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:36.838489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 132/252] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:36 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:36.844239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:36.885622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:36.987110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b64b4b-10af-4e61-b2dc-688d1c2cf7e2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:37.036683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:37.037646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.037877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.038157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732/users/5281ce03bb2c49e3a20d975f53b183bf/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.044180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] RBAC: Authorizing `identity:create_grant(project_id=83372225aaa24948a3e30d4aa887c732, user_id=5281ce03bb2c49e3a20d975f53b183bf, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:37.045709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:37.092221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c42fe-83cc-418b-9abd-67cdc4c4b022 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.092749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c42fe-83cc-418b-9abd-67cdc4c4b022 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.092826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c42fe-83cc-418b-9abd-67cdc4c4b022 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.094426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 133/253] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:37.099934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.100229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.100508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.123809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:37.125031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:37.144017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 121/254] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:36 2022] PUT /identity/v3/projects/83372225aaa24948a3e30d4aa887c732/users/5281ce03bb2c49e3a20d975f53b183bf/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:37.230561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 134/255] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:37.268559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:37.392575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:37.416145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d427f8-40e2-4ac1-897d-03724253ee4d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:37.466190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4671e-ec04-4f0a-837b-c62696c590a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:37.467515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4671e-ec04-4f0a-837b-c62696c590a1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.468186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4671e-ec04-4f0a-837b-c62696c590a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.468694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4671e-ec04-4f0a-837b-c62696c590a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.485619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4671e-ec04-4f0a-837b-c62696c590a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-ffb4671e-ec04-4f0a-837b-c62696c590a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:37.494080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:37.494998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:37.495780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:37.498114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 122/256] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:37.503890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:37.507528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:37.543209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f353b7-fd64-435b-81fc-02e101fcda2c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.543492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f353b7-fd64-435b-81fc-02e101fcda2c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.543931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f353b7-fd64-435b-81fc-02e101fcda2c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.545696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 123/257] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:37.550844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.551310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.551726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.568485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:37.569861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:37.669033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dfa23-1f5a-43b2-b8d0-c0d691fc6ed4 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:37.700344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 124/258] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:37.720357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:37.721262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:37.721685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:37.722165 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:37.723368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:37.723820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:37.725331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:37.734548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 135/259] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:37.743962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:37.763573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:37.896565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:37.936324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:37.979116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7e66a-179e-4144-8419-bd04cd4ba7df None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:37.992212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e28fc2-f1e9-4b1a-a63e-a3053bcc7375 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:38.061834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:38.062663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:38.062958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:38.063232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:38.072126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:38.072999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:38.073275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:38.073544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] PATH_INFO: `/v3/users/9f6984483e63403eb4ff215649b61f60` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:38.079565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6984483e63403eb4ff215649b61f60)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:38.081024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:38.082671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 125/260] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:37 2022] GET /identity/v3/users/9f6984483e63403eb4ff215649b61f60 => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:38.089177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:38.090600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:38.105752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:38.107209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:38.108012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 136/261] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:38.116552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:38.267694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16ddd8-673e-4b99-84bb-d8edd04c5c98 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:38.292856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c439f-e6f4-43ba-a8a3-c7ca7c2b77d7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:38.323042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:38.334894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:38.335826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:38.336802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:38.337247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:38.347998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:38.347998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:38.347998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:38.356261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 137/262] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:38.362055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:38.388296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:38.388968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:38.389254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:38.389595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:38.417021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:38.547848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:38.549325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:38.554631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8dcf5-9bd7-4d1d-b76e-3bbd564edd9b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:38.624059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:38.625312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:38.626052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:38.626586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] PATH_INFO: `/v3/users/9f6984483e63403eb4ff215649b61f60` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:38.628029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6984483e63403eb4ff215649b61f60)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:38.629656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:38.632735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 138/263] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:38 2022] GET /identity/v3/users/9f6984483e63403eb4ff215649b61f60 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:38.640149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:38.740079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:38.789917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 126/264] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:38.795333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:38.825131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6667b-fc18-4100-9e0b-36719fc14671 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:38.893498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:38.899400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:38.900747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:38.901486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:38.901980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.022346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bcf54-bf2f-4558-87b4-f264b6e90010 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:39.043427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:39.045954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:39.105641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:39.106445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.106747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.107032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.109755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:39.111680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:39.119124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 127/265] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:38 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:39.120010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:39.162635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:39.251723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 139/266] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:39.257263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:39.337814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040a84-0b6a-4307-a772-274e3cd29a00 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:39.367133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:39.400709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:39.401376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.401659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.401935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.402952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=9f6984483e63403eb4ff215649b61f60) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:39.403266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:39.404841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6523390-160e-4ed9-8723-52c3fe234357 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:39.411884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 128/267] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:39 2022] GET /identity/v3/role_assignments?user.id=9f6984483e63403eb4ff215649b61f60&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:39.413720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b7c3-93e2-4dac-940e-01aa7cfff7a3 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.414011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b7c3-93e2-4dac-940e-01aa7cfff7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.414881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b7c3-93e2-4dac-940e-01aa7cfff7a3 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.416425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 129/268] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:39.422125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278d5c-6ded-4c82-b9a6-e9292652b260 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.422417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278d5c-6ded-4c82-b9a6-e9292652b260 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.422714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278d5c-6ded-4c82-b9a6-e9292652b260 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.424466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 130/269] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:39.430360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24882-0b63-434f-8c25-919a0518312b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.430654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24882-0b63-434f-8c25-919a0518312b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.431039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24882-0b63-434f-8c25-919a0518312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.449802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-63e24882-0b63-434f-8c25-919a0518312b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:39.451353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-63e24882-0b63-434f-8c25-919a0518312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:39.477247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617646d9-730b-4b31-8786-e90d39991a93 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:39.527365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 131/270] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:39.529507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.530032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.530509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.561385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:39.562815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:39.566177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499bd31-5196-40bb-99e7-c20c8045bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:39.567486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499bd31-5196-40bb-99e7-c20c8045bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.568001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499bd31-5196-40bb-99e7-c20c8045bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.568474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499bd31-5196-40bb-99e7-c20c8045bf99 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.569995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499bd31-5196-40bb-99e7-c20c8045bf99 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:39.572451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499bd31-5196-40bb-99e7-c20c8045bf99 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:39.574629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 140/271] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:39 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:39.581445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac61c3f-cdb8-418b-9d39-fa75d57400c0 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.581984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac61c3f-cdb8-418b-9d39-fa75d57400c0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.582459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac61c3f-cdb8-418b-9d39-fa75d57400c0 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.584228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 141/272] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:39.586892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac61c3f-cdb8-418b-9d39-fa75d57400c0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:39.619281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:39.645876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 132/273] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:39.647112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:39.694539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:39.713624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac61c3f-cdb8-418b-9d39-fa75d57400c0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:39.762325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84835-55a5-4d67-9474-0d7002306ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:39.763451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84835-55a5-4d67-9474-0d7002306ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.763941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84835-55a5-4d67-9474-0d7002306ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.764393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84835-55a5-4d67-9474-0d7002306ea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.765747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84835-55a5-4d67-9474-0d7002306ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:39.767390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84835-55a5-4d67-9474-0d7002306ea6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:39.769027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 142/274] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:39.770382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.770675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.771006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.783833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821936-f60e-4bd7-8d07-5f9bdf8ca3f8 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:39.792233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:39.793921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:39.824770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:39.825507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:39.825714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:39.825987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:39.826946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] RBAC: Adding query filter params (role.id=934aebd972524ff69425bd080d013143, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=9f6984483e63403eb4ff215649b61f60) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:39.827170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:39.828612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:39.843176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 133/275] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:39 2022] GET /identity/v3/role_assignments?user.id=9f6984483e63403eb4ff215649b61f60&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=934aebd972524ff69425bd080d013143 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:39.844181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:39.873791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 143/276] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:39.875126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:39.906601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:39.979039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:39.982308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a972556-8221-4a2d-b0e7-ba868a6a7612 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.004868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9dfad-a355-4778-bc94-798453f4db86 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.021201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.022010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.022299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.022578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.037475 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:40.045592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:40.046783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 134/277] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:40.047792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.051444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fe06f-ce4b-49f1-9d93-0bbcb23858cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.052134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fe06f-ce4b-49f1-9d93-0bbcb23858cf None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.052426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fe06f-ce4b-49f1-9d93-0bbcb23858cf None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.052704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fe06f-ce4b-49f1-9d93-0bbcb23858cf None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.053427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fe06f-ce4b-49f1-9d93-0bbcb23858cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.055886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fe06f-ce4b-49f1-9d93-0bbcb23858cf None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.133332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 144/278] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:27:39 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:40.134862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831934-30de-4eb3-8872-b2cc7684322e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.135385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831934-30de-4eb3-8872-b2cc7684322e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.135544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831934-30de-4eb3-8872-b2cc7684322e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.136925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 145/279] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:40.137689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831934-30de-4eb3-8872-b2cc7684322e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.162660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a827-f6bb-4cd1-8099-a4a1745ae7b3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.204067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3a2c4-db95-4ea9-8a99-0b2c7260574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.205472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3a2c4-db95-4ea9-8a99-0b2c7260574f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.205768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3a2c4-db95-4ea9-8a99-0b2c7260574f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.206041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3a2c4-db95-4ea9-8a99-0b2c7260574f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.219569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3a2c4-db95-4ea9-8a99-0b2c7260574f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e6c3a2c4-db95-4ea9-8a99-0b2c7260574f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:40.229436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:40.230411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:40.231258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 135/280] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:40.232389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.233656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.234177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.238790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:40.253048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:40.254307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:40.261972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831934-30de-4eb3-8872-b2cc7684322e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.270169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:40.302474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.303520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.303804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.304079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.305762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:40.305997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.312579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.316633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 146/281] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:40.322655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.332467 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 136/282] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:40.333509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.451882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad29a5-ee15-466a-973f-ef6eaddcada1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.462682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb24be-2f12-4278-8fbc-08ef901cc5a0 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.489116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.489794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.490075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.490355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.491158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:40.491522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.493450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.502024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 147/283] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:40.502468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.502874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.503724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.504159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.504569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] PATH_INFO: `/v3/users/efdc51b794304465a8baefcf65bc1f9c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.505513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:40.520660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] RBAC: Authorizing `identity:get_user(user_id=efdc51b794304465a8baefcf65bc1f9c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.522347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.524718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 137/284] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/users/efdc51b794304465a8baefcf65bc1f9c => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:40.525476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.542765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:40.640285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64846a2c-b6ff-43b7-832a-1cca4d020695 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.654515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053af2bf-5ad3-4765-b52c-268467a69f63 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.688995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.690156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.690716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.691197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.691528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.692512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.692859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.693195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] PATH_INFO: `/v3/users/f653c6ce0e7b4832aec99320a6d6620c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.694455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f653c6ce0e7b4832aec99320a6d6620c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.696829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.703170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 138/285] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/users/f653c6ce0e7b4832aec99320a6d6620c => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:40.703170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.711883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:40.723355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:40.724244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:40.725069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:40.728822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 148/286] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:40.730172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.819104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:40.832630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f153c43-cf3c-4539-a192-54e0696193e8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.835026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:40.865722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac9e5-15a2-46ad-9192-ffc06b90c506 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:40.878396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.879370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.879648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.879921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.880762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, user.id=efdc51b794304465a8baefcf65bc1f9c, scope.system=all) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:40.881072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.882513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.889043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 139/287] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/role_assignments?user.id=efdc51b794304465a8baefcf65bc1f9c&scope.system=all&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:40.889851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:40.910157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:40.911450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:40.911936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:40.912454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:40.913968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:40.916306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:40.918508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 149/288] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:40.929846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:41.087683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78844-1c76-409a-afa4-362c432b7da5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:41.097903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d68d2-62bc-47b7-a0a7-5548d6114335 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:41.128234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:41.133693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:41.134645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:41.140060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:41.140060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732/users/f653c6ce0e7b4832aec99320a6d6620c/roles/059406682d354fda8a52fbe50d88febc` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:41.140060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=83372225aaa24948a3e30d4aa887c732, user_id=f653c6ce0e7b4832aec99320a6d6620c, role_id=059406682d354fda8a52fbe50d88febc)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:41.140060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:41.161041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:41.161716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:41.161999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:41.162272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:41.163136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:41.163503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:41.174732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:41.174732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 140/289] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:41.179558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:41.182968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:41.236632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 150/290] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:27:40 2022] PUT /identity/v3/projects/83372225aaa24948a3e30d4aa887c732/users/f653c6ce0e7b4832aec99320a6d6620c/roles/059406682d354fda8a52fbe50d88febc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:41.299402 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f40edf-3527-4e2a-90fd-df8d6a80aeb2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:41.337191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:41.338546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:41.339106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:41.339560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] PATH_INFO: `/v3/users/5281ce03bb2c49e3a20d975f53b183bf` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:41.341162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] RBAC: Authorizing `identity:get_user(user_id=5281ce03bb2c49e3a20d975f53b183bf)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:41.342886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:41.345183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 141/291] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:41 2022] GET /identity/v3/users/5281ce03bb2c49e3a20d975f53b183bf => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:41.350854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:41.509209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c06e-7744-488e-a148-f4b2056a9e1a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:41.556701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:41.557365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:41.557649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:41.557929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:41.626058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:41.637713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:41.639248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:41.751859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 151/292] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:41.757361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:41.852799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:41.884322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed010117-c337-48df-8eac-a1e97ba1fb72 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:41.919176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb45f6-77a8-444f-9269-bbe94bce1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:41.920097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb45f6-77a8-444f-9269-bbe94bce1bba None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:41.920379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb45f6-77a8-444f-9269-bbe94bce1bba None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:41.920652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb45f6-77a8-444f-9269-bbe94bce1bba None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:41.921900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb45f6-77a8-444f-9269-bbe94bce1bba None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:41.923509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb45f6-77a8-444f-9269-bbe94bce1bba None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:41.925545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 142/293] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:41 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:41.931159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:42.082425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:42.092861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da85057-a72b-4318-8953-b1d37b4dd03f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:42.129244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:42.129913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:42.130195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:42.130469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:42.131352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=5281ce03bb2c49e3a20d975f53b183bf) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:42.131664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:42.133231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f7d21-21db-47ac-ae72-b70af7c18f51 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:42.141212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 152/294] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:41 2022] GET /identity/v3/role_assignments?user.id=5281ce03bb2c49e3a20d975f53b183bf&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:42.670461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcec11e-5af8-4b40-b0f4-c7ca9a272419 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:42.671544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcec11e-5af8-4b40-b0f4-c7ca9a272419 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:42.672038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcec11e-5af8-4b40-b0f4-c7ca9a272419 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:42.673615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 143/295] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:42.679294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:42.679750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:42.680529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:42.700706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:42.702040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:42.761608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f9b5-a130-4369-91a9-da85e840eaa0 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:42.761910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f9b5-a130-4369-91a9-da85e840eaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:42.762163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f9b5-a130-4369-91a9-da85e840eaa0 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:42.763596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 144/296] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:42.769068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:42.769355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:42.769632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:42.787206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 153/297] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:42.800688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:42.802207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:42.812509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:42.877835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 145/298] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:42.903305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:42.906485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:42.932888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efbbd4-e102-4209-a607-f23c40d07944 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:42.967071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:42.967874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:42.968161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:42.968440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:42.969822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:42.971325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:42.978008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 154/299] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:42.980281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:42.986172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.023082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4660d9-9e4c-4c9e-ac2f-fb8b5675432d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.059569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.060719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.061209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.061711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.073085 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:43.081285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:43.082176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:43.082990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:43.085692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 146/300] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:43.090738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363ba1-a74b-41ce-84f7-c2de4fb71867 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.091788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.126041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4e0d-92cd-4346-ab65-d3d92bf6cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.126725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4e0d-92cd-4346-ab65-d3d92bf6cf74 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.127014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4e0d-92cd-4346-ab65-d3d92bf6cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.127287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4e0d-92cd-4346-ab65-d3d92bf6cf74 None admin] PATH_INFO: `/v3/groups` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.127981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4e0d-92cd-4346-ab65-d3d92bf6cf74 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:43.129429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4e0d-92cd-4346-ab65-d3d92bf6cf74 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:43.210335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 155/301] 10.222.0.49 () {60 vars in 1134 bytes} [Thu Jul 21 10:27:42 2022] POST /identity/v3/groups => generated 229 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:27:43.224560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abff33-c8ae-45cd-b93f-9e08430b30b0 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.241724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a2e3-2edc-48d1-9234-10ceb4506305 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.242016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a2e3-2edc-48d1-9234-10ceb4506305 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.242949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a2e3-2edc-48d1-9234-10ceb4506305 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.244388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 156/302] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:43.250313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.250640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.250916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.259656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.269509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.270118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:43.270390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.270681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.270989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.271421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:43.271819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:43.272133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:43.273972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:43.280671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.287240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 147/303] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:43.293435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.364982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 157/304] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:43.387942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.428473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8594-42cc-442b-b0b7-5407cf37cd27 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.471176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.471991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.472274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.472803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] PATH_INFO: `/v3/users/a09b9f2180a84ecaa471930c6a6400a3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.489509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] RBAC: Authorizing `identity:get_user(user_id=a09b9f2180a84ecaa471930c6a6400a3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:43.491009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:43.494892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 148/305] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/users/a09b9f2180a84ecaa471930c6a6400a3 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:43.499063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.512551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03fecd-b42c-4618-b6ac-cbba6813dc95 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.550325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.551156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.551441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.551716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.553358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.564368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:43.573086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:43.574076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:43.575116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 158/306] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:43.580259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.583155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.624663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d148b6-2147-489e-80d2-a16085da4a48 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.675270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.676890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.677324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.677776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.678809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] RBAC: Adding query filter params (role.id=059406682d354fda8a52fbe50d88febc, user.id=a09b9f2180a84ecaa471930c6a6400a3, scope.system=all) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:43.680252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:43.682181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:43.689797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 149/307] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/role_assignments?user.id=a09b9f2180a84ecaa471930c6a6400a3&scope.system=all&role.id=059406682d354fda8a52fbe50d88febc => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:43.695110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5480ae-2ee5-4867-a3a3-ff0b04659b96 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.736863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.737931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.738364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.738843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.739784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:43.740251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:43.741827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcc95a-9c45-4a99-88bf-4298889cf740 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:43.753061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 159/308] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:43.759908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.789873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ceb00-5944-4b0c-b1a0-7d4c17ca6f08 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.790343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ceb00-5944-4b0c-b1a0-7d4c17ca6f08 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.790628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ceb00-5944-4b0c-b1a0-7d4c17ca6f08 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.792330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 160/309] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:43.797706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.797993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.798269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.817139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:43.818469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:43.886200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29813e47-6d85-4e80-b072-2d39bfebee7f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:43.903137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.911084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:43.918842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 161/310] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:43.932865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:43.934029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:43.934531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:43.935051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] PATH_INFO: `/v3/users/efdc51b794304465a8baefcf65bc1f9c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:43.936510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] RBAC: Authorizing `identity:get_user(user_id=efdc51b794304465a8baefcf65bc1f9c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:43.938268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:43.941038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:43.943385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 150/311] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/users/efdc51b794304465a8baefcf65bc1f9c => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:43.949369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:44.059136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc180bcc-0429-4726-bc60-93180f1039a6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:44.071366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5671d-ff9d-46e6-a2e5-5e6fb74960d3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:44.098725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:44.100426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:44.101129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:44.101616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:44.108825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:44.109778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:44.110125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:44.110832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] PATH_INFO: `/v3/system/users/efdc51b794304465a8baefcf65bc1f9c/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:44.112709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=efdc51b794304465a8baefcf65bc1f9c, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:44.114351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:44.114474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:44.124038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:44.125096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:44.125930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:44.130114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 162/312] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:44.130882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:44.189944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:44.208978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 151/313] 10.222.0.49 () {58 vars in 1334 bytes} [Thu Jul 21 10:27:43 2022] PUT /identity/v3/system/users/efdc51b794304465a8baefcf65bc1f9c/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:44.252659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25592d45-bb9e-4e9b-b9b7-631b3396b337 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:44.292687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:44.293624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:44.294082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:44.294580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:44.295675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:44.296138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:44.297703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:44.308514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 163/314] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:44.316090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:44.372214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:44.432540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130575-6979-4cbf-8c07-01cda600921f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:44.469069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:44.469969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:44.470308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:44.470590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] PATH_INFO: `/v3/users/f653c6ce0e7b4832aec99320a6d6620c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:44.471870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] RBAC: Authorizing `identity:get_user(user_id=f653c6ce0e7b4832aec99320a6d6620c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:44.473625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:44.475605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 152/315] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:44 2022] GET /identity/v3/users/f653c6ce0e7b4832aec99320a6d6620c => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:44.483891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:44.593729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a20a27-63b6-4e9b-bc6f-fd07d572f981 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:44.611261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:44.629751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:44.630411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:44.630721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:44.630999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:44.702819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:44.704367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:44.807781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 164/316] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:44.813311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:44.921430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6c88e-a33b-46a0-9db3-48ebb863c425 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:44.956802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daae262-2fd1-4e42-b3b2-06a344b4e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:44.958018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae262-2fd1-4e42-b3b2-06a344b4e62b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:44.958496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae262-2fd1-4e42-b3b2-06a344b4e62b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:44.959171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:44.959629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae262-2fd1-4e42-b3b2-06a344b4e62b None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:44.961079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daae262-2fd1-4e42-b3b2-06a344b4e62b None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:44.963146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daae262-2fd1-4e42-b3b2-06a344b4e62b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:44.965377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 153/317] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:44 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:44.971455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:44.990944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:45.081873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba269d-33b9-4339-8a28-218f98ae6e88 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:45.119517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:45.120178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.120503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.120779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.121623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] RBAC: Adding query filter params (role.id=059406682d354fda8a52fbe50d88febc, scope.project.id=83372225aaa24948a3e30d4aa887c732, user.id=f653c6ce0e7b4832aec99320a6d6620c) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:45.121935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:45.123409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177cd62-2341-481f-a2a5-d2073a4ebdbb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:45.129503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 165/318] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:27:44 2022] GET /identity/v3/role_assignments?user.id=f653c6ce0e7b4832aec99320a6d6620c&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=059406682d354fda8a52fbe50d88febc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:45.431574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671291e6-84d3-40c6-a883-266611d57993 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.431968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671291e6-84d3-40c6-a883-266611d57993 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.432145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671291e6-84d3-40c6-a883-266611d57993 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.433667 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 154/319] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:45.438712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.439002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.439273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.456606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:45.457836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:45.529210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 166/320] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:45.550995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671291e6-84d3-40c6-a883-266611d57993 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:45.653059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671291e6-84d3-40c6-a883-266611d57993 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:45.685821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ae3c-0f04-4e36-9389-5559d041ef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:45.686542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ae3c-0f04-4e36-9389-5559d041ef79 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.686852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ae3c-0f04-4e36-9389-5559d041ef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.687130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ae3c-0f04-4e36-9389-5559d041ef79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.688332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ae3c-0f04-4e36-9389-5559d041ef79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:45.689829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ae3c-0f04-4e36-9389-5559d041ef79 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:45.691648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 155/321] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:45.697766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:45.709264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:45.805676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd1e92-be80-4166-a18d-2d197c3ecee2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:45.832398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711448-e1db-4a50-aa16-8c6364257cdf None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.832915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711448-e1db-4a50-aa16-8c6364257cdf None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.833023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711448-e1db-4a50-aa16-8c6364257cdf None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.834720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 156/322] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:45.839547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.839829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.840159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.845034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85a02-487c-4685-81da-463231342895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:45.845773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85a02-487c-4685-81da-463231342895 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:45.845995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85a02-487c-4685-81da-463231342895 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:45.846271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85a02-487c-4685-81da-463231342895 None admin] PATH_INFO: `/v3/groups` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:45.847028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf85a02-487c-4685-81da-463231342895 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:45.848746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf85a02-487c-4685-81da-463231342895 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:45.857527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:45.858706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:45.903148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:45.925157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 157/323] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:45.939427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 167/324] 10.222.0.49 () {60 vars in 1134 bytes} [Thu Jul 21 10:27:45 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:27:45.953120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:46.065297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e073ede-9134-47d5-b9e9-149a5391808e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:46.105774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:46.106570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.106877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.107145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.118768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:46.126459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:46.127347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:46.128128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 158/325] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:46.134519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85a02-487c-4685-81da-463231342895 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:46.213803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:46.249241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85a02-487c-4685-81da-463231342895 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:46.311374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:46.312055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.312339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.312616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.313386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:46.313695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:46.315110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111bbcc-4fb6-445b-b9d2-f09af508acbe None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:46.324888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 168/326] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:46.330328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:46.386188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:46.405252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395009e8-b001-4f53-8fb4-8f75c4eb19f4 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.405541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395009e8-b001-4f53-8fb4-8f75c4eb19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.405817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395009e8-b001-4f53-8fb4-8f75c4eb19f4 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.407477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 169/327] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:27:46.412738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.413027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.413327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.434162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:46.435545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:46.464204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72535af-1e4c-4cdc-ad56-a1985151e2b8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:46.503236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:46.504120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.504425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.504695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] PATH_INFO: `/v3/users/a09b9f2180a84ecaa471930c6a6400a3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.506017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] RBAC: Authorizing `identity:get_user(user_id=a09b9f2180a84ecaa471930c6a6400a3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:46.507621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:46.509769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 159/328] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:46 2022] GET /identity/v3/users/a09b9f2180a84ecaa471930c6a6400a3 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:46.515211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:46.516771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 170/329] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:46.542381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:46.620144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:46.648727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6f78-a5f4-4e1a-923b-f8b69d49fe87 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:46.659082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:46.669252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4324-00da-4c0c-9752-cf5b1e138e2e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:46.697888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:46.699873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.700518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.700979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] PATH_INFO: `/v3/system/users/a09b9f2180a84ecaa471930c6a6400a3/roles/059406682d354fda8a52fbe50d88febc` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.703738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a09b9f2180a84ecaa471930c6a6400a3, role_id=059406682d354fda8a52fbe50d88febc)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:46.706058 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:46.720847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:46.720847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.720847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.720847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.736206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:46.745794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:46.753629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:46.754410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 171/330] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:46.755118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:46.774761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 160/331] 10.222.0.49 () {58 vars in 1334 bytes} [Thu Jul 21 10:27:46 2022] PUT /identity/v3/system/users/a09b9f2180a84ecaa471930c6a6400a3/roles/059406682d354fda8a52fbe50d88febc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:46.890489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ed208-8973-4a0a-8a07-345b7a7193b0 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:46.916645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:46.933441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:46.934515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:46.935030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:46.935490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:46.936468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:46.937029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:46.938679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:46.949715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 172/332] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:46.958360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:47.085052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbc724-8694-488d-b307-82f33d2628e4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:47.126929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7f41b-49f0-447e-9bf8-5a020bc44a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:47.127817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f41b-49f0-447e-9bf8-5a020bc44a14 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:47.128100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f41b-49f0-447e-9bf8-5a020bc44a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:47.128378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f41b-49f0-447e-9bf8-5a020bc44a14 None admin] PATH_INFO: `/v3/users/efdc51b794304465a8baefcf65bc1f9c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:47.129582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f41b-49f0-447e-9bf8-5a020bc44a14 None admin] RBAC: Authorizing `identity:get_user(user_id=efdc51b794304465a8baefcf65bc1f9c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:47.131117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f41b-49f0-447e-9bf8-5a020bc44a14 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:47.133743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 161/333] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:46 2022] GET /identity/v3/users/efdc51b794304465a8baefcf65bc1f9c => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:47.139095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:47.254415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401d70c-57bd-4745-b7e9-ad4a049e9218 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:47.297833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:47.298575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:47.298884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:47.299158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:47.300054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] RBAC: Adding query filter params (role.id=6cacf0328bf641858367cd5fa14f09e2, user.id=efdc51b794304465a8baefcf65bc1f9c, scope.system=all) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:47.300365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:47.301820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c00c19-d2e4-40c8-a432-f65ee3e6bc70 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:47.317316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 173/334] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 21 10:27:47 2022] GET /identity/v3/role_assignments?user.id=efdc51b794304465a8baefcf65bc1f9c&scope.system=all&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:48.756373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759ee2-9d84-4fb2-a850-cfc951fdaecd None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:48.756927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759ee2-9d84-4fb2-a850-cfc951fdaecd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:48.757272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759ee2-9d84-4fb2-a850-cfc951fdaecd None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:48.759323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 162/335] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:48.764755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:48.765229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:48.765477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:48.792891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:48.794102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:48.836026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:48.871186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 174/336] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:48.911411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759ee2-9d84-4fb2-a850-cfc951fdaecd None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:48.958473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:49.029094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759ee2-9d84-4fb2-a850-cfc951fdaecd None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:49.068852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:49.069719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.069999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.070309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.081096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:49.089615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:49.090542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:49.091582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 163/337] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:49.098924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:49.217371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd96c-662a-4a80-87b8-1fdbc321d60e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:49.257642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:49.258994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.259278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.259548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.260317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:49.260617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:49.262184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00492fd-9ebd-43dd-ae31-bf0d53863742 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:49.271560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 175/338] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:49.280962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:49.456161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459c56-67a0-4bcd-896c-d88dfd2939b1 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.456515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459c56-67a0-4bcd-896c-d88dfd2939b1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.456747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459c56-67a0-4bcd-896c-d88dfd2939b1 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.458108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 176/339] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:49.470155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:49.474954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf434de-27f4-40f8-ad0f-e5493098c94a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:49.476445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd073d5c-9e4b-468c-8f12-0e738bdc1504 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.477246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd073d5c-9e4b-468c-8f12-0e738bdc1504 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.477524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd073d5c-9e4b-468c-8f12-0e738bdc1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.515354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee640698-cb4d-4b82-848c-c239f0ba66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:49.515769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bd073d5c-9e4b-468c-8f12-0e738bdc1504 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:49.516024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee640698-cb4d-4b82-848c-c239f0ba66bb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.516310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee640698-cb4d-4b82-848c-c239f0ba66bb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.516583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee640698-cb4d-4b82-848c-c239f0ba66bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.517061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bd073d5c-9e4b-468c-8f12-0e738bdc1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:49.575862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:49.620829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee640698-cb4d-4b82-848c-c239f0ba66bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:49.622306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee640698-cb4d-4b82-848c-c239f0ba66bb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:49.669218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 177/340] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:49.671575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a4992-d376-46ab-b691-0fbe047a1f38 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.671863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a4992-d376-46ab-b691-0fbe047a1f38 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.672140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a4992-d376-46ab-b691-0fbe047a1f38 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.673676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 178/341] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:49.679609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.680501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.680719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.702861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:49.704349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:49.755142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:49.765530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 164/342] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:49.767631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51c49-fa38-4d0a-bac0-83034c0472c6 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.768337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51c49-fa38-4d0a-bac0-83034c0472c6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.770605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51c49-fa38-4d0a-bac0-83034c0472c6 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.779215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 165/343] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:49.779215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51c49-fa38-4d0a-bac0-83034c0472c6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:49.804145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 179/344] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:49.806132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:49.920440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:49.926261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51c49-fa38-4d0a-bac0-83034c0472c6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:49.929971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad011c97-f384-4e98-a9a7-e5842a33e415 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:49.969383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:49.970597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.971145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.971677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.976343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545011f-ea4d-4d90-8884-88c0ddf9b595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:49.976991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545011f-ea4d-4d90-8884-88c0ddf9b595 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.977370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545011f-ea4d-4d90-8884-88c0ddf9b595 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.977651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545011f-ea4d-4d90-8884-88c0ddf9b595 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.979984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545011f-ea4d-4d90-8884-88c0ddf9b595 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:49.981324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545011f-ea4d-4d90-8884-88c0ddf9b595 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:49.983717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 180/345] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:49 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:49.985016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:49.985302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:49.985839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:49.990044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:49.999087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:49.999993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:50.000767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:50.003245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 166/346] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:50.004246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:50.004365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.005552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:50.072937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:50.087255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 181/347] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:50.088227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.120783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15db38-7f30-4ab2-b057-a407cde53eb8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.161189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.162529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.164904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.165613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.186099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:50.194606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:50.195675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:50.196568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 167/348] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:50.197837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.230715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:50.243738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468cc2-59ba-4ea1-a6ff-d5ff958b49a9 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.293280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.294543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.295078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.295573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.304814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:50.309757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:50.309757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 182/349] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:50.309985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.319871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff5b1-f624-4976-89ad-ccee5968d20d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.343110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:50.359077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.360454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.360454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.360454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.361460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:50.361735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:50.363205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:50.372816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 168/350] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:50.373661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.448406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0fae-67c9-4ee7-9133-4364651f2395 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.493030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.493843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.494129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.494406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.496319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399e45-0381-498a-a18e-079733903b1a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.507111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:50.517175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:50.518177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 10:27:50.519504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:50.522783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 183/351] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:50.524990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.543277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.543963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.544503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.544787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.546054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:50.547523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:50.548389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:50.549777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:50.566335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 169/352] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:50.567498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.634291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:50.651437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad214d2-3951-483b-a8df-6487b992fb76 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.687054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.687716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.687999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.688275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.689121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=19718448a5c043e99250c2caa2fe2ef9) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:50.689434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:50.690898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:50.697623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 184/353] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:50.698267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.709557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bd14d-f7e2-4931-86fa-49693f6a8adb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.760299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d995504-bcb9-45a6-8d7f-21a745b112f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.761647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d995504-bcb9-45a6-8d7f-21a745b112f9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.761989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d995504-bcb9-45a6-8d7f-21a745b112f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.762272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d995504-bcb9-45a6-8d7f-21a745b112f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.817287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:50.838207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278beb-e39f-496d-982e-aa6ea1abc289 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:50.866443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d995504-bcb9-45a6-8d7f-21a745b112f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:50.869437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d995504-bcb9-45a6-8d7f-21a745b112f9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:50.882479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:50.884235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:50.884678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:50.884958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:50.885833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:50.886150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:50.887650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:50.897185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 185/354] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:50.898020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:50.938164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.026596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 170/355] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:51.027797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d190-377b-4921-af7f-eef2bad333ff None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.028083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d190-377b-4921-af7f-eef2bad333ff None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.028359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d190-377b-4921-af7f-eef2bad333ff None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.029821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 171/356] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:51.030758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf223a-7a8b-4eac-ba9e-32ab2b5b81b6 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.032005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf223a-7a8b-4eac-ba9e-32ab2b5b81b6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.032287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf223a-7a8b-4eac-ba9e-32ab2b5b81b6 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.035018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c02c-ba68-4255-b85c-2e2d565677e5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.038942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 172/357] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:51.040183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf223a-7a8b-4eac-ba9e-32ab2b5b81b6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.075865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246494-5163-42b8-a1d9-838c8e4c9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.076527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246494-5163-42b8-a1d9-838c8e4c9d50 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.076813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246494-5163-42b8-a1d9-838c8e4c9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.077091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246494-5163-42b8-a1d9-838c8e4c9d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.092303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.167132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246494-5163-42b8-a1d9-838c8e4c9d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:51.168941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246494-5163-42b8-a1d9-838c8e4c9d50 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:51.179136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf223a-7a8b-4eac-ba9e-32ab2b5b81b6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.231804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.233503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.234009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.234487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] PATH_INFO: `/v3/users/a09b9f2180a84ecaa471930c6a6400a3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.236326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] RBAC: Authorizing `identity:get_user(user_id=a09b9f2180a84ecaa471930c6a6400a3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:51.238083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:51.239928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 173/358] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/users/a09b9f2180a84ecaa471930c6a6400a3 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:51.240536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.254415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.318658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 186/359] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:51.320397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4b9e-9695-4691-ae87-52ab50c67c76 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.321011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4b9e-9695-4691-ae87-52ab50c67c76 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.321503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a4b9e-9695-4691-ae87-52ab50c67c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.340688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-342a4b9e-9695-4691-ae87-52ab50c67c76 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:51.342281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-342a4b9e-9695-4691-ae87-52ab50c67c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:51.381108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47147980-4150-44d6-80c6-962349b7b604 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.385196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.425959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 187/360] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:51.427540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.428245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.428386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.428740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.429552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.430005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.430494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.431875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:51.433443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:51.436965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 174/361] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:51.437949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.451395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:51.452781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:51.535130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.542725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 188/362] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:51.543301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.574210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c5926-8fd1-4802-9899-83d0373346e0 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.620768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.621431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.621714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.621986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.623432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] RBAC: Adding query filter params (role.id=059406682d354fda8a52fbe50d88febc, user.id=a09b9f2180a84ecaa471930c6a6400a3, scope.system=all) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:51.623432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:51.624603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:51.639573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 175/363] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/role_assignments?user.id=a09b9f2180a84ecaa471930c6a6400a3&scope.system=all&role.id=059406682d354fda8a52fbe50d88febc => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:51.640112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.676494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6be12-a71a-457a-a500-a2bfd48baaf8 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.691081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.730755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.732209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.732602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.732989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.734440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:51.736105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:51.738269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 189/364] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:51.739088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.768458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48908c8-0648-4b28-8d5b-bab3bb7a15da None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.808972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.809855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.810196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.810543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.813201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:51.814668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:51.816495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 176/365] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:51.817270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.823374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.869391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448786d-63b2-440e-8c21-764cf0667ccb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.917091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.918258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.918878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.919478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:51.939107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:51.943690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60145a-3680-4f4c-b598-ac2091601325 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:51.948127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:51.949071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:51.950394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 190/366] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:51.951280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:51.988470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:51.994519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:51.995370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:51.995650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:51.995922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.011616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:52.019746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:52.020658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 177/367] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:52.021869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:52.091925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b78c6-1de6-4013-bfae-3ac76bd115df None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.114566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:52.139827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.140621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.140904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.141183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.142832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.145089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.146767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 191/368] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:51 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:52.148538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:52.162431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2d00-bc01-45e8-af0f-f00eddb6349b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.204247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.204908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.205203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.205481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.206740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=83372225aaa24948a3e30d4aa887c732) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:52.207396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.208848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.217999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 178/369] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:27:52 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:52.218876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:52.285909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:52.290712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbbef8-8ed5-46a9-984d-81ed20c9b0ff None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.346094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.347066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.347398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.347956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.349107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:52.349419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.350850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.365505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 192/370] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:52.366725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:52.368607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3c238-af74-439a-8de0-8dd3b7c803e4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.408512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:52.419594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.421802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.421802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.421802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.422358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:52.422669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.425618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.437244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 179/371] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:52.438084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:52.515954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0a44-23ec-4ae0-b7fb-b85e72199880 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.563314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.564254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.565219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.565647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.566970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=934aebd972524ff69425bd080d013143, scope.project.id=19718448a5c043e99250c2caa2fe2ef9) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:52.567775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.570127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.578679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 193/372] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:27:52 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=934aebd972524ff69425bd080d013143 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:52.580311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:52.588899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949066-6880-4807-8ecb-73f64b7d8a80 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.616443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:52.712286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.712988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.713273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.713897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.716927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb088ca-e0bf-421f-a1f3-9d0f7648e303 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:52.760929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218df3e-d27b-4588-bf2a-c563d5fc9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:52.762019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218df3e-d27b-4588-bf2a-c563d5fc9be4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:52.762556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218df3e-d27b-4588-bf2a-c563d5fc9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:52.763057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218df3e-d27b-4588-bf2a-c563d5fc9be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:52.860780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218df3e-d27b-4588-bf2a-c563d5fc9be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.863293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218df3e-d27b-4588-bf2a-c563d5fc9be4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.872198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:52.874093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:52.883630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:52.896171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.011869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 194/373] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:53.016950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21eb75-2d60-4dc5-9e61-a6ed87aef95e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.016950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21eb75-2d60-4dc5-9e61-a6ed87aef95e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.016950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21eb75-2d60-4dc5-9e61-a6ed87aef95e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.017612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 180/374] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:53.019118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.019312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 195/375] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:53.020519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21eb75-2d60-4dc5-9e61-a6ed87aef95e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.121804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.132112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75edd1-0073-46ad-ab3b-28eb6889b52c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.134585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21eb75-2d60-4dc5-9e61-a6ed87aef95e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.161404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.169824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15dda0-7b22-4d49-9e81-a5d7604b08ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.170930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15dda0-7b22-4d49-9e81-a5d7604b08ff None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.171385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15dda0-7b22-4d49-9e81-a5d7604b08ff None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.176570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15dda0-7b22-4d49-9e81-a5d7604b08ff None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.176570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15dda0-7b22-4d49-9e81-a5d7604b08ff None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.176570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15dda0-7b22-4d49-9e81-a5d7604b08ff None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.176857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.176995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 181/376] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.177090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.177090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.177225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] PATH_INFO: `/v3/projects/1821efd315e44bfda0a46040701ac779` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.178347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] RBAC: Authorizing `identity:get_project(project_id=1821efd315e44bfda0a46040701ac779)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.178617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.179096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.179561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.179904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.182381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 196/377] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/projects/1821efd315e44bfda0a46040701ac779 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.183173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.200804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:53.202437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:53.279835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 182/378] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:53.279835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.317744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd3e2-e397-4c9c-8788-7a5c1203836c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.362607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.364330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.364926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.365382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.367790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.369837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.372330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 197/379] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.378097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.404738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.418881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b3af-678b-445e-992d-d9a1b7a7bde7 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.444115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.457831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.458881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.459269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.459642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] PATH_INFO: `/v3/groups/f1493903351f4103b95bc6e4a0891256` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.466822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] RBAC: Authorizing `identity:get_group(group_id=f1493903351f4103b95bc6e4a0891256)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.468218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.470410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 183/380] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/groups/f1493903351f4103b95bc6e4a0891256 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.471850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.493434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee4d4-0272-47e8-b1f7-108184a3cfbd None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.533021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.534162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.534671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.535170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.547313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:53.556597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:53.557541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:53.558328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:53.561019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 198/381] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:53.561975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.583242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548d6b-2298-4f7b-903e-a84976dabc5e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.620877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.621704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.622082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.622460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.623479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=934aebd972524ff69425bd080d013143, scope.project.id=83372225aaa24948a3e30d4aa887c732) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:53.623880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.625426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.633087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 184/382] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=934aebd972524ff69425bd080d013143 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.633087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.652466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.692629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7e98-6372-4f91-8454-7f58b83d08aa None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.718034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:53.734971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.736012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.736659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.737139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.738255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] RBAC: Adding query filter params (group.id=f1493903351f4103b95bc6e4a0891256, role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=1821efd315e44bfda0a46040701ac779) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:53.738914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.740723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.746509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac922c-5d18-425b-af55-98598b142ea1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.749166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 199/383] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/role_assignments?group.id=f1493903351f4103b95bc6e4a0891256&scope.project.id=1821efd315e44bfda0a46040701ac779&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.789662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.790273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.790557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.790882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.791680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:53.791995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.793450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.803726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 185/384] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:53.809441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:53.936237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf7661-e4d3-4c77-ad7e-3e1be78a7183 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:53.976929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:53.977806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:53.978091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:53.978368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:53.979609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:53.981052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:53.983015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 200/385] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:53.988522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:54.073955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:54.096443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd38e1-f6c0-4528-a907-2a2ff1320486 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:54.134210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2497d-b047-46da-a7f4-ce4f49964994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:54.135122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2497d-b047-46da-a7f4-ce4f49964994 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:54.135405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2497d-b047-46da-a7f4-ce4f49964994 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:54.135682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2497d-b047-46da-a7f4-ce4f49964994 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:54.136922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2497d-b047-46da-a7f4-ce4f49964994 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:54.138379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2497d-b047-46da-a7f4-ce4f49964994 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:54.140490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 186/386] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:53 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:54.147773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:54.213196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:54.277357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d623e2-2c42-4403-9ed2-5c9f0e78d959 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:54.329446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b8aae-5b4d-4598-9d3d-6209299e8b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:54.330259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8aae-5b4d-4598-9d3d-6209299e8b4f None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:54.330545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8aae-5b4d-4598-9d3d-6209299e8b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:54.330850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8aae-5b4d-4598-9d3d-6209299e8b4f None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:54.332860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b8aae-5b4d-4598-9d3d-6209299e8b4f None admin] RBAC: Authorizing `identity:create_grant(project_id=19718448a5c043e99250c2caa2fe2ef9, group_id=a1d74aaf30db4bdea5cfd23ef06bbf95, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:54.334318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b8aae-5b4d-4598-9d3d-6209299e8b4f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:54.414641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 201/387] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 21 10:27:54 2022] PUT /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:54.663530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c7e2-a1b4-40bc-88f0-5a664c9dbebc None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:54.663879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c7e2-a1b4-40bc-88f0-5a664c9dbebc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:54.664092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c7e2-a1b4-40bc-88f0-5a664c9dbebc None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:54.665556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 187/388] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:54.672121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:54.672412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:54.672692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:54.694808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:54.696779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:54.776067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 202/389] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:54.811792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122c7e2-a1b4-40bc-88f0-5a664c9dbebc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:54.921188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122c7e2-a1b4-40bc-88f0-5a664c9dbebc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:54.955710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:54.956558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:54.956848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:54.957122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:54.968717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:54.977927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:54.978859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:54.979644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 188/390] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:54.985275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:55.062298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:55.139720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205d98a-03b3-4c87-8f3c-ab34e3507d41 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:55.189769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:55.190369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:55.190653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:55.190959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:55.191722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:55.192029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:55.193402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:55.206556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 203/391] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:55.213118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:55.228302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:55.350780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd94b-4a72-47dc-8a51-60d009971101 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:55.385518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:55.386381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:55.386734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:55.387023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:55.388209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:55.389643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:55.391640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 189/392] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:55 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:55.400474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:55.548381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9c9f3-d9b4-49f9-a03d-529a743033a2 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:55.550598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:55.589222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93019e63-abdf-47d0-a6b3-770d579c949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:55.590089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93019e63-abdf-47d0-a6b3-770d579c949f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:55.590369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93019e63-abdf-47d0-a6b3-770d579c949f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:55.590637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93019e63-abdf-47d0-a6b3-770d579c949f None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:55.591877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93019e63-abdf-47d0-a6b3-770d579c949f None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:55.593302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93019e63-abdf-47d0-a6b3-770d579c949f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:55.595343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 204/393] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:55 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:55.601074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:55.741541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:55.770883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edec19-2101-412f-a4c9-81578f26fc2f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:55.771213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edec19-2101-412f-a4c9-81578f26fc2f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:55.771441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edec19-2101-412f-a4c9-81578f26fc2f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:55.773515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 205/394] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:55.781258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:55.781258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:55.781258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:55.806167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:55.809929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:55.829519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea096c7-f397-4260-8061-61106f4a9d79 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:55.921995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4f7c-8468-4713-baa8-757b6470fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:55.923217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4f7c-8468-4713-baa8-757b6470fbce None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:55.923690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4f7c-8468-4713-baa8-757b6470fbce None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:55.924125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4f7c-8468-4713-baa8-757b6470fbce None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:55.933319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4f7c-8468-4713-baa8-757b6470fbce None admin] RBAC: Authorizing `identity:create_grant(project_id=83372225aaa24948a3e30d4aa887c732, group_id=a1d74aaf30db4bdea5cfd23ef06bbf95, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:55.936449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4f7c-8468-4713-baa8-757b6470fbce None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:55.967816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 206/395] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:55.990490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.038195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 190/396] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 21 10:27:55 2022] PUT /identity/v3/projects/83372225aaa24948a3e30d4aa887c732/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:56.253097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3f6c9-9a5e-427f-9749-a605c75eea44 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:56.259429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:56.330323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:56.331192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.331481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.331762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.355691 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:56.364045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:56.364964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:56.365820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:56.366420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d26f4-bbb1-4f3d-8bc4-52f01f068061 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.366420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d26f4-bbb1-4f3d-8bc4-52f01f068061 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.366420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d26f4-bbb1-4f3d-8bc4-52f01f068061 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.367662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 207/397] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:27:56.367810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 191/398] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:56.375487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.376179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac74a5-c72d-4836-b3a7-971bbcc472e5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.376595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac74a5-c72d-4836-b3a7-971bbcc472e5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.378402 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac74a5-c72d-4836-b3a7-971bbcc472e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.404598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-aaac74a5-c72d-4836-b3a7-971bbcc472e5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:56.405831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-aaac74a5-c72d-4836-b3a7-971bbcc472e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:56.499871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 192/399] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:56.525669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13692bc-be61-4041-9e64-d34286ac117c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.526459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13692bc-be61-4041-9e64-d34286ac117c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.526960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13692bc-be61-4041-9e64-d34286ac117c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.529172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 193/400] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:56.531764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13692bc-be61-4041-9e64-d34286ac117c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.573556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96766-05a7-4037-acef-aac7c619c015 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:56.614368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:56.616229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:56.617032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.617359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.617630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.618496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:56.618830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:56.620258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbb8b7-fe59-48df-9fae-3748385b5837 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:56.634278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 208/401] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:56.635771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.636059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.636331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.653939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:56.655231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:56.663100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13692bc-be61-4041-9e64-d34286ac117c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:56.674033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:56.701026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:56.702210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.702725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.703220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.717025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:56.728040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:56.728963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:27:56.730294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:56.732830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 194/403] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:56.733901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.735251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 209/403] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:56.739321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.845358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83788fea-fa93-4eae-92f8-45ed684fc415 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:56.854677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551ffe9-eafc-4975-a960-b739b6363c91 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:56.871737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:56.884080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:56.885552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.886076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.886307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.887604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:56.889254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:56.891567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 195/404] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:56 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:56.892440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.895629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763843d-aa58-452a-a092-157811c97125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:56.896355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763843d-aa58-452a-a092-157811c97125 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:56.896644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763843d-aa58-452a-a092-157811c97125 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:56.896924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763843d-aa58-452a-a092-157811c97125 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:56.897689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763843d-aa58-452a-a092-157811c97125 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:56.897996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763843d-aa58-452a-a092-157811c97125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:56.900112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763843d-aa58-452a-a092-157811c97125 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:56.908933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 210/405] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:27:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:56.913961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763843d-aa58-452a-a092-157811c97125 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:56.933821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.004954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a264c8-0578-49b1-9591-d62bb6ba9a2e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.018067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763843d-aa58-452a-a092-157811c97125 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.044525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885cd77-b8b1-4686-b37e-fead2868bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.045249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885cd77-b8b1-4686-b37e-fead2868bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.045773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885cd77-b8b1-4686-b37e-fead2868bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.045881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885cd77-b8b1-4686-b37e-fead2868bbe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.053501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.054358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.054666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.054991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.056175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.056923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885cd77-b8b1-4686-b37e-fead2868bbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:57.057601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.064146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 211/406] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:56 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:57.064146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f885cd77-b8b1-4686-b37e-fead2868bbe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:57.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:57.065833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:57.066635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 196/407] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:57.067983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252442f-299a-4f97-b6d8-02a242ab356a None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.068185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252442f-299a-4f97-b6d8-02a242ab356a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.068335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252442f-299a-4f97-b6d8-02a242ab356a None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.069752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 197/408] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:57.074725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252442f-299a-4f97-b6d8-02a242ab356a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.132009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.158451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.174085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9a51-2a6e-410f-a2a8-d8f742af976e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.181394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252442f-299a-4f97-b6d8-02a242ab356a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.214153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.215051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.215336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.215611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.216794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.217373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de64c-b849-4196-aafe-987ecba6b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.218275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.218375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de64c-b849-4196-aafe-987ecba6b68e None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.218570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de64c-b849-4196-aafe-987ecba6b68e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.218876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de64c-b849-4196-aafe-987ecba6b68e None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/934aebd972524ff69425bd080d013143` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.224725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 212/409] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:57.224725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.225525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de64c-b849-4196-aafe-987ecba6b68e None admin] RBAC: Authorizing `identity:create_grant(project_id=19718448a5c043e99250c2caa2fe2ef9, group_id=a1d74aaf30db4bdea5cfd23ef06bbf95, role_id=934aebd972524ff69425bd080d013143)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.227309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de64c-b849-4196-aafe-987ecba6b68e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.328974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1ed28-b93c-4c66-8c79-4010907fdb6c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.330432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 198/410] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 21 10:27:57 2022] PUT /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/934aebd972524ff69425bd080d013143 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:57.339001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.339001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.339001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.356525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:57.361450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:57.388817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.389507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.389785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.390061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.390873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:57.391223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.392945 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.409067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 213/411] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:57.410068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.431954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.469148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 199/412] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:27:57.470766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.531955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c646b04-afc3-4dd2-90e4-d128fdb9ea19 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.532677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.584084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.585017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.585469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.585755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.588047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.592587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.592587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 214/413] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:57.593624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.602650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4f544-cf64-4a18-8032-eb9000a0cee2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.648294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.649977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.650266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.650548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] PATH_INFO: `/v3/groups/f1493903351f4103b95bc6e4a0891256` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.652337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] RBAC: Authorizing `identity:get_group(group_id=f1493903351f4103b95bc6e4a0891256)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.653797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.656325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 200/414] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/groups/f1493903351f4103b95bc6e4a0891256 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:57.657091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.688796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.708450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d339a6-d5c4-469e-b8f4-ee4bac02d9bb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.748005 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.749169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.749664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.750143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.762069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:57.770170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:57.771155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:57.771939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:27:57.775222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 215/415] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:57.776246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.799543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad926b-acd2-4c31-adc1-a3198375fafa None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.827122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:57.836556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.837748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.838276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.838653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/934aebd972524ff69425bd080d013143` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.841903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] RBAC: Authorizing `identity:create_grant(project_id=83372225aaa24948a3e30d4aa887c732, group_id=a1d74aaf30db4bdea5cfd23ef06bbf95, role_id=934aebd972524ff69425bd080d013143)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.844665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.888925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9daa5-d5dc-4a37-89c6-3dbf3b08941b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:57.925200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:57.926072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:57.926383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:57.926654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] PATH_INFO: `/v3/projects/1821efd315e44bfda0a46040701ac779` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:57.927848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1821efd315e44bfda0a46040701ac779)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:57.929286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:57.936039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 216/416] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/projects/1821efd315e44bfda0a46040701ac779 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:57.936874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.936972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 201/417] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 21 10:27:57 2022] PUT /identity/v3/projects/83372225aaa24948a3e30d4aa887c732/groups/a1d74aaf30db4bdea5cfd23ef06bbf95/roles/934aebd972524ff69425bd080d013143 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:57.937751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:57.969381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:58.104376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6025ed5-fcc5-4926-89c0-95d6d6a3aeea None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:58.147736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe687f-d721-4abc-b092-dccf5fb792a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:58.149552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe687f-d721-4abc-b092-dccf5fb792a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.150179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe687f-d721-4abc-b092-dccf5fb792a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.151104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe687f-d721-4abc-b092-dccf5fb792a1 None admin] PATH_INFO: `/v3/projects/1821efd315e44bfda0a46040701ac779/groups/f1493903351f4103b95bc6e4a0891256/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.153685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe687f-d721-4abc-b092-dccf5fb792a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1821efd315e44bfda0a46040701ac779, group_id=f1493903351f4103b95bc6e4a0891256, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:58.156797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe687f-d721-4abc-b092-dccf5fb792a1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:58.169903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6168b-810d-45ac-bf76-424afac712a1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:58.211964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:58.212649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.212992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.213281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.214114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] RBAC: Adding query filter params (name=member) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:58.214423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:58.216047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:58.227174 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 217/418] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:58.232884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:58.269394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 202/419] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Jul 21 10:27:57 2022] PUT /identity/v3/projects/1821efd315e44bfda0a46040701ac779/groups/f1493903351f4103b95bc6e4a0891256/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:27:58.315452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:58.349556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936eaec-a8f8-444b-a7e9-866c846ce49d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:58.401304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4883-8899-4519-8d39-5002b9a01a67 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.401599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4883-8899-4519-8d39-5002b9a01a67 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.401783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:58.401895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4883-8899-4519-8d39-5002b9a01a67 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.402425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.402724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.403007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.403639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 203/420] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:58.412944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.413228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.413506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.459981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:58.463954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:58.511801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:58.512928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:58.515798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:58.566826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 204/421] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:58.591685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:58.593868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:58.635981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 218/422] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:27:58.643193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:58.750009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a28a-0f40-47bb-b34d-6faeb4634320 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:58.799835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:58.800808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.801160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.801505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.802803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:58.804540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:58.807570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 219/423] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:58 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:58.812920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:58.824641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2500cb-6a3b-47f7-8ccc-fa8b47c3b61c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:58.883746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:58.928872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1edc7-8968-4b2e-9dde-5e064648e064 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:58.939880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:58.941102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:58.941384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:58.941658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:58.960564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:27:58.969942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:27:58.970834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 10:27:58.971655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:27:58.979725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 205/424] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:27:58.985885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:59.006294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:59.007163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.007447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.007722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.009975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:59.011457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:59.017403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 220/425] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:58 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:59.019667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:59.053498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:59.183314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e261fc-a3c3-4f5f-9d40-ef4c3331ca3d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:59.221561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:59.222285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.222570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.223397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.224194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:59.224505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:59.225924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:59.237512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 206/426] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:59.246379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:59.263496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88cf6-5a10-411e-a25c-8cb66e564fbb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:59.287031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:59.340644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:59.352790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:59.353478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.353811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.354097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.354976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=19718448a5c043e99250c2caa2fe2ef9) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:27:59.355294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:59.356732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2e73-0aa5-4164-a1fa-ddd742fe7d0c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:59.360232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21eba08-58e2-462a-bbad-21a95192e8e6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:59.376972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 221/427] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:27:59 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 611 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:27:59.437204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:59.437902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.438187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.438463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.544937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:59.546347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:59.638544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:59.654321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be875-a834-4f43-81a2-379288115678 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.654610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be875-a834-4f43-81a2-379288115678 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.654919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be875-a834-4f43-81a2-379288115678 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.656506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 222/428] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:27:59.657544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 207/429] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:27:59.662068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.662364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.662637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.662883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:59.681642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:27:59.683760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:27:59.783775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 223/430] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:27:59.806424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67c8a-77b9-4426-8ba9-e48a7d81eca8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:59.808656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:59.856148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:27:59.857410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:27:59.857885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:27:59.858349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:27:59.860118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:27:59.861866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:27:59.865131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 208/431] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:27:59 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:27:59.871609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:27:59.938165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:27:59.970656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992535d4-16cd-4124-bfe7-98ebbd17982e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:27:59.973129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.010649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945716-1c01-480a-935b-7fb4dacb23b2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.020303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.021128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.021410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.021684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.036481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:00.045329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:00.046223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:00.047050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 224/432] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:27:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:00.052839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.056102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.057504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.058935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.059387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.060846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.062436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.065116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 209/433] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:27:59 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:00.071447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.187145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd47fb-7f5d-418f-8811-9de2dbfbd4d4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.187743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a98bb-c921-4870-8c31-52f6a2864af7 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.209455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.235748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.236419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.236706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.236984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.237832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=6cacf0328bf641858367cd5fa14f09e2, scope.project.id=83372225aaa24948a3e30d4aa887c732) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:00.238146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.239421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.239604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.240424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.240803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.241176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.242303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:00.243034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.245454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891aa1b-67d7-4899-aadf-bd78813f099e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.252878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 210/434] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=6cacf0328bf641858367cd5fa14f09e2 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:00.255768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 225/435] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:00.262220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.302802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa860c-22a8-4314-9dda-6affcbf475df None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.303366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa860c-22a8-4314-9dda-6affcbf475df None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.303366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa860c-22a8-4314-9dda-6affcbf475df None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.304861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 226/436] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:00.310815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.311282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.311771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.329146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:00.330762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:00.355122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.393629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0453d5-d777-4b31-8f36-e74528c41d13 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.418036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 227/437] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:28:00.435366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.436032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.436318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.436597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.441465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.506171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.525011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.527171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.561593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831883b-b295-4d93-ab7a-747ee170ca8f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.598110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.599205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.599635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.600044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.612120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:00.621022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:00.622032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:28:00.623000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:00.625331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 228/438] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:00.630591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.639532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 211/439] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:00.645147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.652231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.730551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.744149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d5faa-6e85-4d09-b6e2-537ebc0fe663 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.752533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1609f24-6792-477c-8087-b970ec0960fb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.779744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.780766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.781298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.782281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.783319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:00.783637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.785031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.793744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 229/440] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:00.797443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.798309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.798589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.798889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] PATH_INFO: `/v3/projects/19718448a5c043e99250c2caa2fe2ef9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.799062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.800116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] RBAC: Authorizing `identity:get_project(project_id=19718448a5c043e99250c2caa2fe2ef9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.801549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.808362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 212/441] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/projects/19718448a5c043e99250c2caa2fe2ef9 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:00.809126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.879980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:00.903480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd0f7-1317-4f3e-b295-5598ea14e917 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.916107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940b381-2792-44b8-b39a-112aa44c4ebe None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:00.938059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d22ce-e6dc-4c62-aca3-305661665963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.938742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d22ce-e6dc-4c62-aca3-305661665963 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.939032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d22ce-e6dc-4c62-aca3-305661665963 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.939311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d22ce-e6dc-4c62-aca3-305661665963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.953874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:00.954756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:00.955056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:00.955312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:00.956505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:00.957932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:00.964954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 213/442] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:00.965657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:00.986532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.011818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d22ce-e6dc-4c62-aca3-305661665963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.013259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d22ce-e6dc-4c62-aca3-305661665963 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.067307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8131-f6ea-43d4-97bb-aa94f9c1c1dd None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.086342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.101070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.102299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.102577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.102882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.103716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=934aebd972524ff69425bd080d013143, scope.project.id=19718448a5c043e99250c2caa2fe2ef9) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:01.104076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.105513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.109360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 230/443] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:28:01.114076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7987e4-1a2f-4723-bc88-626a4e332d8c None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.114076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7987e4-1a2f-4723-bc88-626a4e332d8c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.114076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7987e4-1a2f-4723-bc88-626a4e332d8c None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.114296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 214/444] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:28:00 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=19718448a5c043e99250c2caa2fe2ef9&role.id=934aebd972524ff69425bd080d013143 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:01.114368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 231/445] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:01.115132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:01.118970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.119263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.119543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.137595 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:01.138805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:01.218734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.231043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 232/446] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:28:01.239333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e986bc-f28b-428d-abe7-ea0a171a6053 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.246312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:01.282548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.283488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.283772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.284051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] PATH_INFO: `/v3/projects/83372225aaa24948a3e30d4aa887c732` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.285392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] RBAC: Authorizing `identity:get_project(project_id=83372225aaa24948a3e30d4aa887c732)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.286870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.288875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 215/447] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/projects/83372225aaa24948a3e30d4aa887c732 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:01.295269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:01.370269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c074d-ef92-42e1-af30-41f3004a9755 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.377479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.407857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1461cc-aecf-4601-a0c1-3637bab3638a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.408649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.410442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.410442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.410442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.425869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:01.435761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:01.436667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:01.437438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 233/448] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:01.443647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:01.453610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.454297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.454584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.454894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] PATH_INFO: `/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.456114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] RBAC: Authorizing `identity:get_group(group_id=a1d74aaf30db4bdea5cfd23ef06bbf95)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.457570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.462758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 216/449] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/groups/a1d74aaf30db4bdea5cfd23ef06bbf95 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:01.465523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:01.487947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.568719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ce29-e710-4ad2-95be-a5db755ccbb4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.583807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507f28a-e75d-4109-80b4-30c10dc2d1ab None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.613965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.614769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.615001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.615221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.615975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:01.616281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.618182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.627556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 234/450] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:01.627722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.628249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.628533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.628814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.629665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] RBAC: Adding query filter params (group.id=a1d74aaf30db4bdea5cfd23ef06bbf95, role.id=934aebd972524ff69425bd080d013143, scope.project.id=83372225aaa24948a3e30d4aa887c732) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:01.629978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.631497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.633841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:01.640390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 217/451] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/role_assignments?group.id=a1d74aaf30db4bdea5cfd23ef06bbf95&scope.project.id=83372225aaa24948a3e30d4aa887c732&role.id=934aebd972524ff69425bd080d013143 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:01.665642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.740692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22dd09-ba9f-469d-99ec-3cabefd0b8e3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:01.776411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:01.777073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:01.777357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:01.777633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:01.851055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:01.853009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:01.879128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:01.952590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 235/452] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:28:01.958003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:02.042309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:02.059964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0372be-5634-4bcb-ab0e-9a29941d55c5 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:02.092670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:02.093520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:02.093805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:02.094080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] PATH_INFO: `/v3/projects/1821efd315e44bfda0a46040701ac779` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:02.095286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] RBAC: Authorizing `identity:get_project(project_id=1821efd315e44bfda0a46040701ac779)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:02.096717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:02.098663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 218/453] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:28:01 2022] GET /identity/v3/projects/1821efd315e44bfda0a46040701ac779 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:02.104820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:02.200387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277032d7-feae-451a-9b0c-db4675e7444d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:02.225651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:02.233515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2a4c-76f2-4195-810d-cd403e99a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:02.234354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2a4c-76f2-4195-810d-cd403e99a379 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:02.234635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2a4c-76f2-4195-810d-cd403e99a379 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:02.234937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2a4c-76f2-4195-810d-cd403e99a379 None admin] PATH_INFO: `/v3/groups/f1493903351f4103b95bc6e4a0891256` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:02.236145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2a4c-76f2-4195-810d-cd403e99a379 None admin] RBAC: Authorizing `identity:get_group(group_id=f1493903351f4103b95bc6e4a0891256)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:02.237565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2a4c-76f2-4195-810d-cd403e99a379 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:02.239217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 236/454] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Jul 21 10:28:02 2022] GET /identity/v3/groups/f1493903351f4103b95bc6e4a0891256 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:02.245782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:02.344120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8078-ef2c-4e70-95d1-8776946b23b3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:02.376950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:02.377599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:02.377889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:02.378172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:02.379045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] RBAC: Adding query filter params (group.id=f1493903351f4103b95bc6e4a0891256, role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=1821efd315e44bfda0a46040701ac779) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:02.379361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:02.380787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bef9-3756-461d-b0f7-161876ca77ac None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:02.386748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 219/455] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Jul 21 10:28:02 2022] GET /identity/v3/role_assignments?group.id=f1493903351f4103b95bc6e4a0891256&scope.project.id=1821efd315e44bfda0a46040701ac779&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:04.750402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6cb4f-38c7-489a-82d8-0be2e38d2dc9 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:04.751285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6cb4f-38c7-489a-82d8-0be2e38d2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:04.751755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6cb4f-38c7-489a-82d8-0be2e38d2dc9 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:04.753511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 237/456] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:04.759735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:04.760144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:04.760288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:04.781520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:04.783107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:04.798826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:04.878421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 220/457] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:04.915291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6cb4f-38c7-489a-82d8-0be2e38d2dc9 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.048490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6cb4f-38c7-489a-82d8-0be2e38d2dc9 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:05.094222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:05.095301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.095763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.096192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.108004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:05.109694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e99f0185-0429-4a5e-a416-793104655c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:05.134154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:05.135340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:05.136443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:05.136443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:05.136443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:05.136443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:05.144355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 238/458] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:05.155807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.172662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db51a-08ba-4ffe-81d5-06081ce2056f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.173164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db51a-08ba-4ffe-81d5-06081ce2056f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.173593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db51a-08ba-4ffe-81d5-06081ce2056f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.175408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 239/459] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:05.189313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.189837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.190267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.216382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:05.218317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:05.288967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994ee21-2a82-4ac6-87f8-fe18e612107d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:05.334221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:05.335172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.338911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.339244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.340030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:05.340351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:05.342306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:05.355691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 221/460] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:05.360508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:05.361365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.367054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:05.411063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 240/461] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:05.453604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.494763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b6ce-91e4-43e1-b307-0c15989860bb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:05.531618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee7797-22ab-4bf5-beee-3520bf9cee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:05.532554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee7797-22ab-4bf5-beee-3520bf9cee95 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.532986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee7797-22ab-4bf5-beee-3520bf9cee95 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.533411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee7797-22ab-4bf5-beee-3520bf9cee95 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.534271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee7797-22ab-4bf5-beee-3520bf9cee95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:05.535990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee7797-22ab-4bf5-beee-3520bf9cee95 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:05.560694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad9ce-0702-42f7-9bd5-5bcee3b72039 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:05.596227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:05.596933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.597214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.597487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.608736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:05.610213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-25a2b685-dbc1-45b7-bc12-9085ecf7ef5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:05.628977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:05.629942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:05.631133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:05.631133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:05.631133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:05.631133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:05.631133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 241/462] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:05.631436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b4e8-0e94-4b0a-b573-8824f3bb77d5 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.631704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b4e8-0e94-4b0a-b573-8824f3bb77d5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.631963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b4e8-0e94-4b0a-b573-8824f3bb77d5 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.637964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 242/463] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:05.637964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ec7b-5359-4706-b03e-f31766fe7b30 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.637964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ec7b-5359-4706-b03e-f31766fe7b30 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.637964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ec7b-5359-4706-b03e-f31766fe7b30 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.637964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 243/464] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:05.637964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973ec7b-5359-4706-b03e-f31766fe7b30 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.656669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 222/465] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:28:05 2022] POST /identity/v3/users => generated 246 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:05.658256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5a56-c05f-45ea-b217-959d88bffdbf None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.658773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5a56-c05f-45ea-b217-959d88bffdbf None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.659354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5a56-c05f-45ea-b217-959d88bffdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.678565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-112e5a56-c05f-45ea-b217-959d88bffdbf None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:05.679909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-112e5a56-c05f-45ea-b217-959d88bffdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:05.680752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:05.748082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:05.760905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 223/466] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:05.762329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.762626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.763105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.783392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973ec7b-5359-4706-b03e-f31766fe7b30 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:05.794013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:05.795600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:05.828216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:05.829359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:05.830107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:05.830840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:05.832032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:05.832498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:05.834469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:05.862189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 244/467] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:05.862189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.888297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 224/468] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:05.889147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:05.985471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:05.996029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e032b-8840-4296-b1a7-5435e4cd7206 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.024066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa5c4-bee2-4d16-b0d1-9c9880be8ceb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.041915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.043015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.043299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.043577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.048234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:06.058716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.060777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.064383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.065191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.065481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.065764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.066532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.068192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:06.081539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:06.082644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:06.083887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:06.083887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:06.083887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:06.083887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:06.083887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 245/469] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:06.084861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.143371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 225/470] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:28:05 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:06.151544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.194627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fd69-f688-4ba8-a8a4-500cd462c5e2 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.236664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.237456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.237819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.238106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.251063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.252556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.254669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:06.274952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:06.275881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:06.276712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:06.276712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:06.276712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:06.276712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:06.281481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 246/471] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:06.282975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.286568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba3d0a-1982-4f3d-8e24-9724b620716a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.324694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.325753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.326250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.326749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.327688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:06.328198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.329806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f432c0-24f7-4882-821b-7b37701ff7fa None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.344616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 226/472] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:06.346383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4378-6fe8-411f-9dfb-5a997c0f310a None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.346924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4378-6fe8-411f-9dfb-5a997c0f310a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.347405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4378-6fe8-411f-9dfb-5a997c0f310a None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.349534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 227/473] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:06.350547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee4378-6fe8-411f-9dfb-5a997c0f310a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.390916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:06.403915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f2ef-e5b5-4032-b646-941cbdedbd96 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.442844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.446088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.446088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.446088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.446088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:06.446088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.447731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af57d-757f-4db2-bce4-9683faf77c15 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.463652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 247/474] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:06.465258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.465545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.465820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.482646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee4378-6fe8-411f-9dfb-5a997c0f310a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.484856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:06.486070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:06.527530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.528210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.528495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.528770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.529484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.531012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.544529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:06.564036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 248/475] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:06.564868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.631166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 228/476] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:28:06 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:06.632026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.715462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597fd3f-c6f0-4bb1-b559-53aeb2b80f4c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.780820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:06.796520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.797231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.797493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.797770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.798577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.800124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.806657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d204-7f2f-49db-a815-82a0f4756a99 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:06.850778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:06.851459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:06.852379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:06.852657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:06.853722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:06.855410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:06.903814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 249/477] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:28:06 2022] POST /identity/v3/users => generated 249 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:06.904000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.sql.core [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 10:28:06.904000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 10:28:06.904000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [parameters: {'id': '99d9f74507fd4a37a3c6611feb5f047d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 10:28:06.904000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application result.read() Jul 21 10:28:06.921931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:28:06.922911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application yield resource Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise self.value Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application session.commit() Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 10:28:06.924052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self.session.flush() Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application compat.raise_( Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 10:28:06.925495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:28:06.926643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application result.read() Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:28:06.927750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [parameters: {'id': '99d9f74507fd4a37a3c6611feb5f047d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:06.931497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 10:28:06.932570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:06.933596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 229/478] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 21 10:28:06 2022] POST /identity/v3/roles => generated 144 bytes in 292 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:06.933726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:06.985761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:07.055408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb121bbe-a571-4ec6-877e-5f4bb37aed9a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:07.105686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa9e6-3262-4445-b7b6-03a9cd42cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:07.106505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa9e6-3262-4445-b7b6-03a9cd42cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:07.106822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa9e6-3262-4445-b7b6-03a9cd42cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:07.107096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa9e6-3262-4445-b7b6-03a9cd42cdd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:07.118416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aa9e6-3262-4445-b7b6-03a9cd42cdd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e95aa9e6-3262-4445-b7b6-03a9cd42cdd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:07.126658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:07.128846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:07.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 250/479] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:07.134258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:07.250096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14a657-976a-4ade-b87e-d03766b44fcd None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:07.286139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:07.287238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:07.287784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:07.288247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:07.289729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:07.290542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:07.292097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88607-1edb-4ece-8b91-8ccbaee3e7d6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:07.301263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 230/480] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:08.113423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b964c-3cb9-4755-bf82-569d67847ff3 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.114141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b964c-3cb9-4755-bf82-569d67847ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.114141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b964c-3cb9-4755-bf82-569d67847ff3 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.115616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 251/481] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:08.121211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.121715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.121886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.141319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:08.142507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:08.157871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:08.227425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 231/482] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:08.258973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b964c-3cb9-4755-bf82-569d67847ff3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:08.395798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:08.401163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b964c-3cb9-4755-bf82-569d67847ff3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:08.441790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03307-16bf-4156-a47b-505c0e3ab12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:08.442587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03307-16bf-4156-a47b-505c0e3ab12a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.442893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03307-16bf-4156-a47b-505c0e3ab12a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.443169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03307-16bf-4156-a47b-505c0e3ab12a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.462327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03307-16bf-4156-a47b-505c0e3ab12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-3ce03307-16bf-4156-a47b-505c0e3ab12a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:08.470313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:08.471230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:08.472256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 252/483] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:08.478622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:08.628592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7fad0-a247-498f-b68f-483a3bb5f3b6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:08.674903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:08.675847 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.676303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.676747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.677671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:08.678168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:08.680304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:08.687323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092fb5-8460-4baa-93fb-785faf4c7aee None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.690410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092fb5-8460-4baa-93fb-785faf4c7aee None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.690908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092fb5-8460-4baa-93fb-785faf4c7aee None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.692464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 253/484] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:08.699286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.699575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.699858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.700537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 232/485] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:08.706895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:08.730615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:08.732164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:08.734937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:08.865238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 254/486] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:28:08.887447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:08.896965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e2f34-7168-4925-b15d-bfd75ecbc084 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:08.938762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:08.940095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:08.940378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:08.940653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:08.965958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:08.967469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:08.992854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:08.993944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:08.995200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:08.995200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:08.995200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:08.995200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:08.995200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 233/487] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:08.999720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.058014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.068604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.080574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769990-dd7d-419c-b0dd-1bddcdd93117 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.140474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c588-9cd8-41af-92d7-2b43aed82e36 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.151541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.153011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.153490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.153958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.172716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:09.181189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:09.182054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:09.182981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:09.190191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 255/488] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:09.191458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.191857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.192143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.192431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.192713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.193518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:09.193829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:09.195358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:09.224993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 234/489] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:09.232592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.350844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ef315-b050-4cb1-b50d-9418560df610 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.383911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d7666-a618-461f-b1a4-f00fee1b2a6b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.393417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.394097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.394380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.394656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.395455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:09.395765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:09.397539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d2a86-fc10-4c31-ac2f-92dfa656af4c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:09.411799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 256/490] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:09.411799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e6d2-a77e-4319-a7c2-e08f019bcd73 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.411799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e6d2-a77e-4319-a7c2-e08f019bcd73 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.411799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e6d2-a77e-4319-a7c2-e08f019bcd73 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.411799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 257/491] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:09.415873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e6d2-a77e-4319-a7c2-e08f019bcd73 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.419533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.433273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.434786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.435272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.435757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.436808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.444818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:09.446979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-39200120-d058-4d0b-a7c4-28e40159207d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:09.464964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:09.467330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:09.468222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:09.469769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 235/492] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:09.471308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.471826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.472292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.492964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:09.494830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:09.549000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e6d2-a77e-4319-a7c2-e08f019bcd73 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.578409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 236/493] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:09.579434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.589024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.590216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.590783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.591278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.604243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:09.606120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:09.628931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:09.629851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:09.631177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:09.631177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:09.631177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:09.631177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:09.631177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 258/494] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:09.631454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.700472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.701613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1614-0330-4882-a462-37e64f932956 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.716193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.738789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.739455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.739736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.740008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.740864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:09.741172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:09.743377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:09.743702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9abb-d8b4-41d9-ae68-f1cf4961fca8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.788255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 237/495] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:09.788255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.802285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.803466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.803751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.804061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.815364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:09.824421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:09.825406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:09.826360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:09.828672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 259/496] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:09.829591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.900646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1660-3e29-4a64-a8aa-cb5e774814c9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.936059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.936758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.937044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.937322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.938055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:09.938365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:09.939808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3c2e-2dd4-44d8-89a0-47d8eb470545 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:09.941596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4c6e-1739-4a52-bf52-92354aebea60 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:09.955965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 238/497] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:09.955965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3905fe7-705a-4f41-97af-94f68ba2ce8c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.955965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3905fe7-705a-4f41-97af-94f68ba2ce8c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.955965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3905fe7-705a-4f41-97af-94f68ba2ce8c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.955965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 239/498] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:09.955965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3905fe7-705a-4f41-97af-94f68ba2ce8c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:09.973901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:09.986069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ede77d-fa7c-480a-abb2-321cece12085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:09.986740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede77d-fa7c-480a-abb2-321cece12085 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:09.987030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede77d-fa7c-480a-abb2-321cece12085 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:09.987323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede77d-fa7c-480a-abb2-321cece12085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:09.989211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.058906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ede77d-fa7c-480a-abb2-321cece12085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.060385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ede77d-fa7c-480a-abb2-321cece12085 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.064172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3905fe7-705a-4f41-97af-94f68ba2ce8c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.098401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.099102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.099382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.099656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.100412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:10.100745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.102845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.110963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 240/499] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:10.111762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.159287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 260/500] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:10.160549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c097a-99d2-4ce8-97b2-5eb3046a1b95 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.160833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c097a-99d2-4ce8-97b2-5eb3046a1b95 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.161106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c097a-99d2-4ce8-97b2-5eb3046a1b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.177323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e90c097a-99d2-4ce8-97b2-5eb3046a1b95 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:10.178520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e90c097a-99d2-4ce8-97b2-5eb3046a1b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:10.195948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.207958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.216443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd2be-2762-44d3-88b1-6c24ab8dd398 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.245952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 261/501] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:10.247324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fbf35-4fa6-4283-ba08-f0c72c765eb8 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.247616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fbf35-4fa6-4283-ba08-f0c72c765eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.247891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fbf35-4fa6-4283-ba08-f0c72c765eb8 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.249161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 262/502] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:10.249846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fbf35-4fa6-4283-ba08-f0c72c765eb8 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.261075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.261881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.262167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.262444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.269991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.271491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:10.286293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:10.287249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:10.288118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 241/503] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:10.288676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.360586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fbf35-4fa6-4283-ba08-f0c72c765eb8 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.391381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147114-cc30-47c2-b292-27a190e1db93 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.393912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.394725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.395013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.395292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.405929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.407421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-2b605138-d2fa-47c8-a479-6914bdd984ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:10.425669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:10.426664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:10.427568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:10.427568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:10.427568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:10.427568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:10.427776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.427776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.427923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 263/504] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:10.427990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.427990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.428105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.428364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.428680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.440637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.442915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.444390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.446921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:10.448101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:10.462082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:10.463001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:10.463867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:10.463867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:10.463867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:10.463867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:10.466963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 242/505] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:10.467795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.471810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.514321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 264/506] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:10.515180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.582237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08884b5a-e192-4c6c-995a-8e10547037ad None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.616079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12e352-04b5-4171-b5cd-73892c4cadc5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.618066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.618894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.619178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.619452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.629411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:10.637914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:10.638832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:10.639628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 243/507] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:10.640285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.655533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.656201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.656486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.656760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.657605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:10.657916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.659373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.670581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.695020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 265/508] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:10.696508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.707474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.745973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616f59-7f71-4223-86f4-0872c47e807b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.782478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.783934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.784373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.784647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.785380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:10.785686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.787064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.796080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf5c8-555f-4e91-be92-ed4d29197f35 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.799496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 244/509] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:10.800274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.831957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.832622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.832905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.833183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.833908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:10.834215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.835657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.846818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 266/510] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:10.847772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.900612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b51de7-4b80-4e72-b723-31118c5b7919 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.903471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.924015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:10.935077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.935869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.936151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.936430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.946517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.947987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.949186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e2486-0245-481b-97aa-a991d5612d5b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:10.965372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:10.966430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:10.967553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:10.967553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:10.967553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:10.967553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:10.967553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 245/511] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:10.967553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:10.986072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:10.986853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:10.987137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:10.987415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:10.988160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:10.988462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:10.989832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:10.998379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 267/512] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:10.998967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.072943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44e54c-3d11-40c0-aaf6-3746260f84cf None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.095790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700f51-6515-4120-b599-94fb4867c47c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.106532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.107208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.107498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.107779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.112241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.130095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.131049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.131326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.131599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.139207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.140643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.152639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:11.156545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:11.157602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:11.158568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 268/513] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:11.159169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.178320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.180406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.259614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7d7ac-00eb-486d-a3df-a2d828bcf02c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.282023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 246/514] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:11.282881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.293623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.294426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.294737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.295021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.301711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.303202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:11.318074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:11.319127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:11.320007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 269/515] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:11.320706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.356400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.363449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.385170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7286f-e431-4a5a-b593-bb0494deb14c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.420222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.420982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.421314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.421606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.421706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be638746-f93b-4e99-80a2-2e08be7fcd7e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.422338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:11.422648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.424043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.435436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 247/516] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:11.436229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.455550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.456342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.456625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.456901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.467287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.468732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:11.486576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:11.487571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:11.488427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:11.488427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:11.488427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:11.488427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:11.488427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 270/517] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:11.488692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.540355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d775-3409-4c59-ae50-bf7e9a41d02f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.572921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.573585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.573866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.574141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.574924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.575059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:11.575316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.576738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.579209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.587499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe5bb-e0d2-40e2-9218-5fd127559048 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.594034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 248/518] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:11.594857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.622217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.623035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.623317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.623592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.634072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.635622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:11.653458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:11.654375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:11.655278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:11.655278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:11.655278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:11.655278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:11.655278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 271/519] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:11.655545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.698448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7ef1-4a1e-4d2c-bee3-59377763fb71 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.732075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.732739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.733023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.733300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.734095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:11.734404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.735865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.753078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb27f1f-97b8-4a22-bcfb-e53c2e02b2ef None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.753211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 249/520] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:11.754017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.792620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.793237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.793523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.793798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.794508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.795997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.805786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.811177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:11.854831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013f487-ef10-4986-993a-d9d0d8727ea6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:11.861850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 272/521] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:28:11 2022] POST /identity/v3/users => generated 247 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:11.874927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.890583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:11.891307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:11.891593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:11.891876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:11.892683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:11.892995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:11.894505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:11.914273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 250/522] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:11.914273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:11.982152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a879c-26b6-43ef-8fee-37f2ad8291ba None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.025593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.026258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.026549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.026863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.029185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a1529-e63e-48a1-b781-86705ad36cc0 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.045353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.075593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.076282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.076570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.076848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.077586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:12.077900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.079319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.092211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 251/523] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:12.094844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.104450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.111071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.112533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.210135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a4e3-3028-4f75-9460-8854075d89d6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.218280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 273/524] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:12.219326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.251738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.252398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.252683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.252962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.253807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0be525488dbf496cb0440dc4b046df85) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:12.254122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.255595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.261335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 252/525] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/role_assignments?user.id=0be525488dbf496cb0440dc4b046df85&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:12.262124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.319374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.360379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.369598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14850b6-13a8-4766-ac7c-11be7ed6d933 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.400502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebcfc-90d6-43f8-b7e3-d9918503091f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.415553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.416689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.417185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.417658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.433861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.436152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.443415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.444219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.444502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.444775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:12.451433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:12.452367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 274/526] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:12.454021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.458832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.460319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:12.478641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:12.479579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 253/527] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:12.480894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.570043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e220a9-f2f7-4151-bd88-79a76e26fe2e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.593337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.598525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a268-a2ab-486a-81d3-63a093c05f41 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.608759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.609791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.610344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.610826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.629550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.631357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.649858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.650908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.651399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.651875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.653009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:12.653590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:12.653694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:12.654486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:12.655792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:12.655792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:12.655792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:12.655792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:12.655792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 275/528] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:12.656233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.658056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.671116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.680677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 254/529] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:12.685984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.801126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c108a-f89c-4882-853f-d47da7968e66 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.801588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52b990-00b5-46e7-8e33-b0eca2131183 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:12.844768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.845949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.846608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.847068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.848351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:12.848559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:12.849026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.849287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:12.849667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:12.850035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:12.850967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:12.851216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.851474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:12.853641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:12.865313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 255/530] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:12.866461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.876573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 276/531] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:12.877817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:12.887345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.972523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:12.989100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8af83-3050-4d28-81bf-59f6ff83dc8d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.020657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35e8d-352a-4ea9-9016-8869dbcca84f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.031019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.031715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.032005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.032288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.069286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.071669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.072497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.072979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.082319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.085088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:13.107356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:13.108217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:13.109075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:13.111825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 277/532] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:13.112743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:13.114216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.115864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.136133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:13.233734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 256/533] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:13.235294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:13.244512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a28b4d-21ff-4f9b-99e5-1a91cbe81d97 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.272811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:13.282038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.283295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.283295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.283535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.284537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=a7d5722330cc432ea6b3c4f505a78669) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:13.284949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.286662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.292554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 278/534] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/role_assignments?user.id=a7d5722330cc432ea6b3c4f505a78669&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:13.293573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:13.382545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e3aa-99a9-4c5f-88c3-393426576fe2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.404895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:13.434852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.435823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.436259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.436683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.437644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:13.438103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.439754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.466444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6011ab-2cc3-4979-a085-1779313ee620 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.470585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 257/535] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:13.481174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:13.530719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.531947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.532338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.538735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.547264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.549686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:13.570623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:13.571828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:13.572892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:13.572892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:13.572892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:13.572892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:13.574717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 279/536] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:13.579685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:13.638573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:13.704201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45b84e-ce08-4cb1-b458-303310a6fb5a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.728866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a86ab5-3a82-41c7-bbba-5a4b4a585c4a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.750714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.750714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.750714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.750714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.751175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:13.751175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.751175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.765741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 280/537] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:13.778185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:13.795974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.796697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.796985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.799099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.801279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=992d129919be4586b6e1c9d1fed498b6) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:13.801599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.805321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.819653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 258/538] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/role_assignments?user.id=992d129919be4586b6e1c9d1fed498b6&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:13.908546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724fe04-2739-435f-896a-2df732306eb1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:13.910904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:13.947356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:13.948188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:13.948471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:13.948746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:13.963860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:13.965340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-2a57950b-436f-4f5d-b76a-0def46cbedac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:13.986749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:13.987671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:13.988514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 281/539] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:13.994460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:14.042482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ba71-67d5-4591-b1f1-7fb3d7c35f80 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.042833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ba71-67d5-4591-b1f1-7fb3d7c35f80 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.043058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ba71-67d5-4591-b1f1-7fb3d7c35f80 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.044530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 282/540] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:14.051890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:14.064446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.064743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.065006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.104005 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:14.105241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:14.125929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b25793-b53f-4efe-9cc9-417f6b7d8130 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:14.169438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:14.170039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.170330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.170611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.171448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:14.171763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:14.173681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:14.188594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 259/541] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:14.194285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:14.222385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 283/542] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:28:14.259435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:14.364608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11119e43-b078-4e98-8a96-08853faab88f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:14.375008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:14.401597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:14.402355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.402540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.402851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.403698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=827c5b6ddf0b4e899dd0c2ab3e05b0d9) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:14.404254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:14.415407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da3162-ae58-48a7-af05-f6ebefb42a6c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:14.415407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 260/543] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:14 2022] GET /identity/v3/role_assignments?user.id=827c5b6ddf0b4e899dd0c2ab3e05b0d9&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:14.517182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:14.526345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8600c2-e534-4d81-a358-dab51f65a793 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:14.565228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53ab7-c338-4e15-b4a6-05ea3bdb36d0 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.565870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53ab7-c338-4e15-b4a6-05ea3bdb36d0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.566360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53ab7-c338-4e15-b4a6-05ea3bdb36d0 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.568274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 261/544] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:14.574782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.575118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:14.575605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.576027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.576303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.576403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.576581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.594518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:14.595741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:14.600911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:14.611688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:14.612609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:14.613398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:14.616278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 284/545] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:14.623123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:14.685217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 262/546] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:28:14.722931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:14.822091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1af61e-0f5d-4a3e-90ee-5ebf69473694 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:14.899414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:14.899619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45233a5d-2b04-4cea-9f81-773e2eab8986 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:14.900103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.900395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.900678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.901136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:14.901448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:14.901761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:14.903192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:14.920376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 285/547] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:14.926683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:14.940778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:14.941646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:14.941925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:14.942239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:14.953456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:14.958263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:14.962743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:14.963805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:14.965193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:14.968359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 263/548] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:14.974192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.083855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8533-8632-4ab9-a4f3-afa503f3a338 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.122596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.123644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.124026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.124440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.125293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:15.125717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.127343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.136935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 264/549] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:15.142479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.171072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:15.255107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbde4ed-bd1b-40ea-acc5-49cd80f533a7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.277094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92724c02-11ca-4deb-9f90-f475d52e0f8c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.295084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.296109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.296509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.297284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.308631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.310228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:15.330828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:15.331898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:15.332990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:15.332990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:15.332990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:15.332990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:15.334615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 265/550] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:15.341492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.360838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.361924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.362212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.362490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.380889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.382358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:15.412806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:15.413731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:15.415522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:15.415522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:15.415522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:15.415522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:15.415522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 286/551] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:15.423763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.427748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:15.466035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b0b18-20a2-450a-90ac-033e28a00c1c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.505409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.506138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.506455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.506750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.507485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:15.507823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.509362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.522099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 266/552] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:15.527912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.636857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40911d5-e90d-434a-8440-f699a3e758bf None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.637648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:15.672361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:15.681712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.682914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.682914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.683145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.696916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.698370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.701637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53efead-7810-4168-8612-5e4919a62a66 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:15.731675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:15.732677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:15.733600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:15.742921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 267/553] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:15.746884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.763224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.764349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.764883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.765360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.766440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:15.767082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.768675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3844a-4e38-4691-bf41-4c2cb08dc3bd None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.782626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 287/554] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:15.784247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4068e0-2098-4c43-b4b1-52f129201943 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.784739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4068e0-2098-4c43-b4b1-52f129201943 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.785303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4068e0-2098-4c43-b4b1-52f129201943 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.791705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 288/555] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:15.793532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4068e0-2098-4c43-b4b1-52f129201943 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.862627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac1b6c-fe26-42b0-8116-b3c7672db0f3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.898496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.899779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.900271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.900701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.901698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:15.902172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.903786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11238-5b04-4933-bb09-43a70726592e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.906580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4068e0-2098-4c43-b4b1-52f129201943 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:15.922286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 268/556] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:15.923880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.924308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.924741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.941058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:15.942068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:15.943308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:15.951976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:15.956632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:15.956632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:15.956632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:15.964907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:15.966538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:15.986852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:15.988279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:15.989185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:15.997393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 289/557] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:15.997393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:15.998035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.028740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 269/558] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:16.033514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.115874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d01c3-9eb3-4796-ad7a-93829a7fdb73 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.154970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.155157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d7a4-13d4-4a5c-a187-59c8970ab92c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.155742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.156039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.156318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.167623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.169163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:16.188665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:16.189638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:16.190522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:16.190522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:16.190522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:16.190522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:16.190522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 290/559] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:16.191253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.191349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.192444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.192444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.192635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.196701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:16.196701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.196701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.216131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 270/560] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:16.216980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.238540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.254526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.304604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eef974-ce0e-403a-830e-0385a05942a8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.327849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a3570-18d2-4534-a35f-144892018d70 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.343686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.344826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.344974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.345256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.357175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:16.365648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:16.366824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:16.368371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:16.370345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.371213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.371645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.371846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 291/561] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:16.372240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.372705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.373367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:16.373823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.375525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.389040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 271/562] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:16.390294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.477294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.480417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a56b-701b-418e-87d9-abf7db8acd15 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.497629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.504218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7a71-bda4-499f-9aac-8c083e94669b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.515904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.516552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.516837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.517115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.541409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.542427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.542738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.543025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.543786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:16.544096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.545472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6948d-7832-4a32-beac-74e6e735cc86 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.554729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 272/563] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:16.556301 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b251-ad4a-4182-9c72-09d7ae32c757 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.556593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b251-ad4a-4182-9c72-09d7ae32c757 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.556874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b251-ad4a-4182-9c72-09d7ae32c757 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.562215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 273/564] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:16.562215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b251-ad4a-4182-9c72-09d7ae32c757 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.595643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.597126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.671910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b251-ad4a-4182-9c72-09d7ae32c757 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.703179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.706702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 292/565] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:16.707513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.716226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.717387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.720277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.720277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.725944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.727492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e8188cb4-c15f-4dc6-8768-68f589286b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:16.741562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:16.743083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:16.743967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 274/566] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:16.744859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.744859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.745110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.761662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:16.762883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:16.776474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.806128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6691-11f7-4282-945d-03d92170b6af None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.831812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 275/567] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:16.832738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.839948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.840874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.841219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.841553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.852194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.853648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-1eba0c22-fd0b-464b-8ddf-b3b537ca9ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:16.871189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:16.872080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:16.872967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:16.872967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:16.872967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:16.872967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:16.872967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 293/568] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:16.873581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96c89-c5e8-42fd-bb83-847769e9912c None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.873852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96c89-c5e8-42fd-bb83-847769e9912c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.874125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96c89-c5e8-42fd-bb83-847769e9912c None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.875391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 294/569] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:16.876070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b96c89-c5e8-42fd-bb83-847769e9912c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:16.928883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:16.946995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4eec5-c4ce-466e-b107-95491f0facf8 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.975959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b96c89-c5e8-42fd-bb83-847769e9912c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:16.981630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:16.982372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:16.982661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:16.982967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:16.993202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:16.994649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.001562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.010773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.011435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.016957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.016957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.016957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:17.017212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:17.018060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:17.019094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:17.019094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:17.019094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:17.019094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:17.019373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.019457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 276/570] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:17.019546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.019630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.030718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 295/571] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:17.031545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.115523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5cedc-39b3-428e-b38a-2e74441aa41c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.130130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a695ece-5380-45df-b007-763a9bcd522f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.143502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.150441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4702d-8e0c-473a-987d-1491d79bfdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.155253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4702d-8e0c-473a-987d-1491d79bfdef None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.155253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4702d-8e0c-473a-987d-1491d79bfdef None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.155253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4702d-8e0c-473a-987d-1491d79bfdef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.161980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4702d-8e0c-473a-987d-1491d79bfdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:17.163807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.164614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.164727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.164991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.165705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:17.166008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.167395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-fba4702d-8e0c-473a-987d-1491d79bfdef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:17.169910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:17.170848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:17.171676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 277/572] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:17.172905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.172905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.172905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.179799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 296/573] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:17.181045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.189625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:17.190846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:17.245776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.259792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 278/574] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:17.260666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.297410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331aa69-53e5-4660-93cb-dee8f10ca0a4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.332287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.332967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.333247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.333520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.334238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:17.334551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.335958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.347205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 297/575] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:17.347990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.362654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e2afa-8a5c-4ee5-9eea-8ef9ce241d75 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.378184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.397003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.397908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.398188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.399049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0be525488dbf496cb0440dc4b046df85/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.413230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=0be525488dbf496cb0440dc4b046df85, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.414842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.447489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bdf19-ace6-48a4-b9be-eac1650433fa None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.479856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.480515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.480795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.481068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.481812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:17.482115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.483504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.490585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 279/576] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:17 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0be525488dbf496cb0440dc4b046df85/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:17.491257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.491354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 298/577] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:17.492110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.552965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.606420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.614119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e1d0-3c07-4de7-92be-55bf676c1376 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.625262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6122a3b-bb6b-4975-8afd-0c12d5616928 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.658903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.659704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.659980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.660246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.667783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.668586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.668868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.669239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.673337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:17.676545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.677991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:17.681931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:17.682965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:17.683834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 299/578] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:17.684536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:17.696591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:17.697646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:17.698604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 280/579] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:17.699695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.800311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af51f96-9c12-45b5-801b-c1262131032a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.812598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.816929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee27f7-0a6e-45b4-ad8f-652eeacbf06d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:17.837825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.838623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.838937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.839205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.846076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.847596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.852916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:17.853715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:17.853999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:17.854277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:17.862736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:17.863794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:17.864943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:17.867884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:17.868680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 300/580] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:17.869503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.869920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:17.886091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:17.888710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:17.889591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:17.890488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:17.890488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:17.890488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:17.890488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:17.890488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 281/581] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:17.891208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:17.985319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5c72-5a87-45d3-8c8c-7fd0a3f24727 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.007307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9f3c6-bda5-4925-8701-fbbc471c0c69 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.021560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.022241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.022523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.022841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.023591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.024126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.025571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.033838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 301/582] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.034627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.048244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.049155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.049458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.049716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.050567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.050909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.052332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.076644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 282/583] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 21 10:28:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.076644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.084991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.125683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.149210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f85bd-9d49-4c7b-8b9f-bcd1f7d063a4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.180427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271daf39-92d2-4a61-915d-4557bc11b8e8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.183604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.184269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.184550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.184823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.185620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.185932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.187405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.200516 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 302/584] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.201342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.218150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.222462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.222462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.222462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.222462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.222462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.222462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.239916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 283/585] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.240874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.362611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.364204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22ca6-b17e-4327-913a-35db72bf126c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.395566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d02b7b-eee8-4413-af4a-6fecbb100248 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.405463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.406385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.406675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.406978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.410071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.418175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.422663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.432692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.433486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.433772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.434048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:18.437170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:18.438150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:18.443940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:18.443940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:18.443940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:18.443940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:18.443940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 303/586] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:18.443940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.450598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.452461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:18.471477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:18.472420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:18.473578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:18.473578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:18.473578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:18.473578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:18.473578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 284/587] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:18.473874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.552835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d376a-a72d-4259-8142-b0e47da86032 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.583170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6429-78ac-4230-a2c0-93ec6cfdf9ad None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.588772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.589423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.589701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.589971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.590833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=24ea97317d564485a0982fe7533561be) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.591143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.592565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.598079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 304/588] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/role_assignments?user.id=24ea97317d564485a0982fe7533561be&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.599139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.632417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.644574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.645389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.645848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.646093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.655836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.657742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.665713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:18.674871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:18.676080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:28:18.677288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:18.679884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 285/589] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:18.681075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.725002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46bd9-5800-46d3-933c-b0aa8714ff70 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.763897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.764625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.764918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.765198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.766055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.766304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.767860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.785881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 305/590] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.786912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.830097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a5de7-72cd-401f-bb23-79fa6fcd7c81 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.875842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.876513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.876800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.877077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.877805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.878115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.879531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.893130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 286/591] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.893950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:18.906908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20231-e5b8-4696-90ef-700681cd5e76 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:18.925126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.939984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:18.954070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:18.955150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:18.955894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:18.956355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:18.957633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:18.958251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:18.960084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:18.982302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 306/592] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:18.983498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.018214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0e83c-b799-48b0-bea6-f343566be727 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.067137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.068225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.068686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.069562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.080797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.083346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.094710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d06ed-2f5e-4176-b134-71d11631ff42 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:19.104841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:19.105990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:28:19.107151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:19.114786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 287/593] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:19.116371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.153269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.154321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.154783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.155217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.165590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.168401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:19.190215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:19.191377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:19.192478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:19.194873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 307/594] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:19.196690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.231965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:19.234953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:19.238209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8ead5-7d36-46ba-8119-7534af232974 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.278379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558177-19f7-47a5-b243-324918b02782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.279668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558177-19f7-47a5-b243-324918b02782 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.280193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558177-19f7-47a5-b243-324918b02782 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.280765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558177-19f7-47a5-b243-324918b02782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.293065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558177-19f7-47a5-b243-324918b02782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.294992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558177-19f7-47a5-b243-324918b02782 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.306914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00d15-493d-4def-b783-3654a272fc62 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-42558177-19f7-47a5-b243-324918b02782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:19.316882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:19.317817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:19.318789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:19.318789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:19.318789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:19.318789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:19.321844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 288/595] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:19.322989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558177-19f7-47a5-b243-324918b02782 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.350038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.350737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.351137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.351398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.352653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:19.352853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.354280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.373716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 308/596] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:19.374599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.439815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558177-19f7-47a5-b243-324918b02782 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.474525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:19.480578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.481506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.482034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.482592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.490867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:19.490867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.490867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.491145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea275fe-37d7-4a67-8bf3-cfe5fbf4236f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.499387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 289/597] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:19.500569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.520092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:19.539502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.540772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.541286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.541867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.543852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:19.544385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.545990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.563415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 309/598] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:19.565091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.614185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301af7bc-6e31-44e5-9baf-f4db22d9013e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.650129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.650953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.651243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.651517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.662384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.663884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.673374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33686a-4e0e-4afb-bb8d-716f8737b7a3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-2b7b2daf-52f7-40f1-9fc6-a439ced3a04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:19.681922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:19.683029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:19.683957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:19.683957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:19.683957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:19.683957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:19.683957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 290/599] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:19.684808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263aecb-450a-40bf-b95c-f9174b03ab6d None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.685101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263aecb-450a-40bf-b95c-f9174b03ab6d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.685381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263aecb-450a-40bf-b95c-f9174b03ab6d None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.690551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 291/600] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:19.690551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263aecb-450a-40bf-b95c-f9174b03ab6d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.719310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.720205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.720490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.720937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/a7d5722330cc432ea6b3c4f505a78669/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.736584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=a7d5722330cc432ea6b3c4f505a78669, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.738104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.754056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:19.795697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263aecb-450a-40bf-b95c-f9174b03ab6d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:19.809388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:19.815084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 310/601] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:19 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/a7d5722330cc432ea6b3c4f505a78669/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:19.816261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:19.853670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:19.854969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.855262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.855587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.866329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:19.869779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-da8490a5-83aa-4535-9423-a0eb4e4c1be2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:19.889717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:19.890739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:19.891669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:19.894855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 292/602] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:19.896666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:19.896960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:19.897309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:19.921070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:19.922358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:19.967185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcac4a-eeb3-46e7-b24d-79cbbb6b58e0 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.006654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 293/603] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:20.007588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.010430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.011132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.011411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.011685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.012432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:20.012718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.014080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.026341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 311/604] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:20.031720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.071518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:20.095631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:20.117820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f0e6-1dd2-4c27-82e6-24a16b2040fc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.139702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc909c-e203-499d-bc54-28d473a9be4e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.157999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.159025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.159513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.159990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.161026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:20.161551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.163219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.175339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.176133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.176413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.176685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.177534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 294/605] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:20.178556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.184465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.185986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:20.201571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:20.202503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:20.203711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 312/606] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:20.204191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.294112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646df8ac-9f40-4654-a487-668f2f1fce76 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.310281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:20.310733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd8ea-74d1-43df-9de9-6e9a0215fd76 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.329698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:20.334107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.335215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.335701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.336761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.348878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.349772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.350052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.350319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/992d129919be4586b6e1c9d1fed498b6/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.350518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:20.359760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:20.360717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 295/607] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:20.362304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.367224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=992d129919be4586b6e1c9d1fed498b6, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.369655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.468577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2442-b0a4-4f21-be6a-dad3a1998535 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.495425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 313/608] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:20 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/992d129919be4586b6e1c9d1fed498b6/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:20.496578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.527398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.529306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.530293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.531954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.534082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:20.536953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.538018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.569055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 296/609] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:20.574932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.619266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:20.709455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a24bfc-68d0-4251-8de7-dc957d25da55 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.733286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1ccee-d182-44cf-8ecc-8b78519384bf None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:20.766737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.767833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.768133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.768411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.769443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:20.769757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.771261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3536-a55d-4633-abf9-faac569730f3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.775361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8d8bb-2feb-43d2-af38-3660164fc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:20.775361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d8bb-2feb-43d2-af38-3660164fc6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.775361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d8bb-2feb-43d2-af38-3660164fc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.775361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d8bb-2feb-43d2-af38-3660164fc6e3 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/827c5b6ddf0b4e899dd0c2ab3e05b0d9/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.786812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 314/610] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:20.787188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887f48-d6b6-4e51-a696-d664808ab71f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.788661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887f48-d6b6-4e51-a696-d664808ab71f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.789158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887f48-d6b6-4e51-a696-d664808ab71f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.791476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 315/611] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:20.792326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887f48-d6b6-4e51-a696-d664808ab71f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:20.800466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d8bb-2feb-43d2-af38-3660164fc6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=827c5b6ddf0b4e899dd0c2ab3e05b0d9, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:20.802130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d8bb-2feb-43d2-af38-3660164fc6e3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:20.825848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:20.876917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 297/612] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:20 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/827c5b6ddf0b4e899dd0c2ab3e05b0d9/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:20.880459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:20.880459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:20.880459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:20.906350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:20.907609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:20.939704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887f48-d6b6-4e51-a696-d664808ab71f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.009433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.010286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.010529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.010830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.030590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:21.032172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:21.052009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:21.052957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:21.053861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:21.053861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:21.053861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:21.053861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:21.053861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 316/613] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:21.060253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.068943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 298/614] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:21.099933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.119605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:21.167801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:21.190570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c584c0-48f2-4bdc-a8cb-fd882ee058e5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.234473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.235193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.235483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.235760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.235866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323083-07ca-4c6d-b1bb-a8f80639d40e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.236594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:21.236903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:21.238279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:21.250894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 317/615] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:21.260156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.303396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.304377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.304851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.305374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.329116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:21.338867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:21.339981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:21.341021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:21.342506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 299/616] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:21.364607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.431386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3211c-0434-492c-88ac-1086006f9869 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.469921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.470853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.471141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.471448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.479292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:21.480938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:21.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:21.497179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:21.498129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 318/617] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:21.503382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.519715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:21.535066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:21.547633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2ea4-696c-4a73-9443-d0363dce46a6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.588261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.589733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.589733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.589733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.590341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:21.590646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:21.592058 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:21.604009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 300/618] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:21.614456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.632012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35def8-a92d-4507-9b5d-7c497a52f847 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.682401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.683518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.684029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.684652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.686332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:21.687150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:21.688813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:21.734774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 319/619] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:21.738605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.799142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c065c-4664-43a2-b09e-ea7fd3cad441 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:21.861651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:21.862676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:21.863511 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:21.863793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:21.864062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:21.875234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:21.884835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:21.886236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:21.915310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:21.921892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:21.922820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:21.922820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:21.922820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:21.922820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:21.922820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 301/620] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:21.922820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:21.942707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390d22c-7a76-4e8d-bad4-513f2d7f56c1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.006464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a26a-ef3c-4269-af98-ed64f7e5f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.007138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a26a-ef3c-4269-af98-ed64f7e5f92a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.007417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a26a-ef3c-4269-af98-ed64f7e5f92a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.007686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a26a-ef3c-4269-af98-ed64f7e5f92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.100342 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e996-692d-4f3b-ac58-c68c70fde9f1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.125178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a26a-ef3c-4269-af98-ed64f7e5f92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.126626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a26a-ef3c-4269-af98-ed64f7e5f92a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.162130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.162734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.163019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.163290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.164014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:22.164864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.166225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.190646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 302/621] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:22.196494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.228790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:22.255810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:22.286732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 320/622] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 10:28:22.286732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177862e6-447f-4664-9680-ffc9eb4a638a None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.286732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177862e6-447f-4664-9680-ffc9eb4a638a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.286732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177862e6-447f-4664-9680-ffc9eb4a638a None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.288059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 321/623] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:22.290889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177862e6-447f-4664-9680-ffc9eb4a638a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.316211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b831bd-b400-4dba-9ec6-d53a4168b17d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.354064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.356025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.357053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.358153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.366558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.370260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b2b97da8-a347-403c-a1d7-5c5440fe7d47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:22.385923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:22.386908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:22.388062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:22.390229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 303/624] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:22.391848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.392338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.392826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.410843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:22.413347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:22.426256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177862e6-447f-4664-9680-ffc9eb4a638a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.474863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.476043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.476540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.477556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.488891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.490805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.502904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 304/625] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:22.505538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:22.517603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:22.518502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:22.519431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:22.519431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:22.519431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:22.519431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:22.521470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 322/626] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:22.522561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.544611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:22.576487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:22.645144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eef48-3e05-416a-bfd7-9883ad804e08 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.653333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d44da1-bd02-4dc9-a5ba-6df937981b54 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.691901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.692596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.693119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.693270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.693611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.693882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.693993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.694397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.694839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:22.695193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.697525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.712917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:22.717511 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 305/627] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:22.718524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:22.726002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:22.727281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:22.728265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:22.732561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 323/628] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:22.733639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.818460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:22.851226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b5e67-1499-4727-a45b-2ad84a0b6cf4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.861896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:22.869687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d637b-f3ec-4a68-8370-b58f50237d86 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:22.893283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.894081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.894377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.894647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.906415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.906828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:22.907499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.907786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.907956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.908051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.908778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:22.909090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:22.910472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:22.922232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 306/629] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:22.923079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5ffb7969-deb4-45b0-976e-8d82f0906257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:22.926063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:22.927018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:22.928002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:22.928002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:22.928002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:22.928002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:22.928002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 324/630] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:22.928830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de46ea-9b68-4a08-a3ba-62aecf8bf90b None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:22.929121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de46ea-9b68-4a08-a3ba-62aecf8bf90b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:22.929402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de46ea-9b68-4a08-a3ba-62aecf8bf90b None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:22.931052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 325/631] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:22.931773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de46ea-9b68-4a08-a3ba-62aecf8bf90b None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.035529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10567-d450-4bb7-901a-bbe01f9762c4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.043832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de46ea-9b68-4a08-a3ba-62aecf8bf90b None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.068484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.072660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.073334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.073618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.073891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.074710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.075030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.076420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.082089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.082089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.082379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.082728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.090125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 307/632] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:23.090125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.095340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.096915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.107265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-574b39c1-fd76-4530-8cec-a9a19df499a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:23.114904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:23.121476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 326/633] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.122370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.123032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.138363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:23.140350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:23.198739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19289f0-60ed-47c2-a12b-77ddd6844656 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.218720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 327/634] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:23.218720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.247158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.247840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.248129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.248413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.249152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.249466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.250881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.263148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 308/635] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:23.263962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.326007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb84263-03e1-4adb-ac6c-bce9722e8fe1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.341296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.345890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.361028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.361863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.362151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.362427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.366614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bcbb6-e74a-4f85-915d-3ab5f25d2f47 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.372712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.374238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:23.392644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:23.393750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:23.394681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:23.394681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:23.394681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:23.394681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:23.394681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 328/636] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:23.394681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.406078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.406772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.407053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.407399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.408512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.409000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.410953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.423111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 309/637] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:23.423886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.498530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677896-99cc-40c6-9267-39dd61cc6ff3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.525273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a3b8e-5159-4ad8-a7a5-097cc0cdbb97 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.532272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff077-b7cd-421c-a78e-e1ce3829e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.533072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff077-b7cd-421c-a78e-e1ce3829e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.533359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff077-b7cd-421c-a78e-e1ce3829e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.533639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff077-b7cd-421c-a78e-e1ce3829e8e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.544125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff077-b7cd-421c-a78e-e1ce3829e8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-072ff077-b7cd-421c-a78e-e1ce3829e8e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:23.551899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:23.553135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:23.554202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 329/638] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:23.555851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0000b7-375e-46ea-984f-513fdc4414f5 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.555851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0000b7-375e-46ea-984f-513fdc4414f5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.555851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0000b7-375e-46ea-984f-513fdc4414f5 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.557265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 330/639] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:23.557972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0000b7-375e-46ea-984f-513fdc4414f5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.563412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.564239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.564524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.564801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.572422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.573865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.575623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.585906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:23.587885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:23.588934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:23.589835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 310/640] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:23.590344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.666347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0000b7-375e-46ea-984f-513fdc4414f5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.688524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2765fc-01d1-4c0d-9fbe-51ea5131a186 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.699984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.700648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.700932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.701211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.701939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.702249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.703648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.715293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 331/641] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:23.715909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.725702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.726357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.727212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.727602 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.728460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0be525488dbf496cb0440dc4b046df85) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.728774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.730194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ef83-34d8-4d8e-8227-0f8c8c1131c7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.736006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 311/642] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/role_assignments?user.id=0be525488dbf496cb0440dc4b046df85&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:23.737158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.737447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.737732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.756186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:23.757539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:23.828415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.831226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:23.843425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 312/643] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:23.844208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.850939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c8a3-f6ec-48ae-96bd-6d036acf8146 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.895323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.896263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.896575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.897994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.897994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.897994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.900119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:23.909651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 332/644] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:23.910663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:23.957247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ac810-2773-4341-8707-ee40ab010775 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:23.995587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:23.996263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:23.996546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:23.996819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:23.997625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:23.997937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:23.999392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.014827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 313/645] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:24.014827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.030771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e148-ac86-436e-b3b8-e2041ec0dc25 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.068271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.069095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.069376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.069650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.070268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.082221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.083923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:24.103309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:24.104449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 333/646] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:24.110424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.121118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06943-395a-4526-be41-cf269b1809bb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.125351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.155849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.156646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.156925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.157195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.167959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:24.175696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:24.176825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:24.177899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:24.182403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 314/647] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:24.183452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.229540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e693c-d466-476c-b4d1-67cbdb94cd66 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.265957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.266887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.267240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.267583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.279789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.281728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.292964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c90241-a8b5-4903-9563-ac5ccaf4fca2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:24.300701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:24.301790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:24.302893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:24.302893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:24.302893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:24.302893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:24.303129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 334/648] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:24.303753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.311682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.333192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.334229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.334611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.335026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/24ea97317d564485a0982fe7533561be/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.350529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=24ea97317d564485a0982fe7533561be, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.352746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.371050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.410916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80865df-6c78-400f-94d0-26a32b0cc4b9 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.443071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.443731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.444012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.444366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.445200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:24.446207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.447672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.465109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 335/649] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:24.465899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.488854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 315/650] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:24 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/24ea97317d564485a0982fe7533561be/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:24.489563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.597898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e963b1-bff6-472d-bcff-7e1fddf54646 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.620273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.640318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.640919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.641200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.641532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.642618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:24.642903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.644468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.658346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 336/651] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:24.658346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.679111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de990d-1c3b-4536-a393-616da6cac1a2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.719527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.720203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.720569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.720744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.721480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:24.721797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.723229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.736452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 316/652] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:24.737300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.763732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.800264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4b4e-0b69-4a11-b190-ac882ed74b1f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.847594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.848813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.849226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.849677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.851371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29adcce-f2fa-4b94-8357-64ba772b19bf None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:24.891218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:24.892048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:24.892336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:24.892767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:24.906221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.907765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:24.913793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:24.928286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:24.929428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:24.931171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:24.931171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:24.931171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:24.931171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:24.933183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 317/653] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:24.934233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:24.941258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:24.943254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.028626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.059839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fa3cb-c2f5-417e-840e-d310d8a4c983 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.063265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 337/654] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:25.064117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.105314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.106432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.106929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.107412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.117873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.120197 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:25.150796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:25.151766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:28:25.152720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:25.153256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 318/655] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:25.153905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.160255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.182350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814ebd8-0bb5-48a1-ac46-8beacfd79301 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.224539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.226091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.227358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.228105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.229265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:25.230157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.232703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.250767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 338/656] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:25.251895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.286040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520286b-acdc-4289-ad55-56bc6d70257b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.331199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.332547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.333398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.333824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.337100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.350601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.353390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:25.379428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:25.380544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:25.381651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:25.381651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:25.381651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:25.381651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:25.382598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d87b2-71a0-41fa-8427-cbfe07207459 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.383779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 319/657] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:25.385102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.427806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.428554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.428942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.429324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.431274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:25.431795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.433353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.445198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.460060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 339/658] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:25.460712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.524630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d23d-ff65-4fd6-8e1b-bcae2ed62a5d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.567452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.568650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.569099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.569586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.575907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05035-928c-4adc-bc4c-a5e343014e12 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.579729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.581363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:25.600357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:25.603027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 10:28:25.604904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:25.608294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 320/659] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:25.609461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.614323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.614869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.615221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.615562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.616370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:25.616745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.618770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.636749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 340/660] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:25.636749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.674003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.699360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.748477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8eaa-f59c-41d0-819d-948c1d79093b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.751056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c2a3-1465-4a82-9699-90a3281a13ee None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.796937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.797678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.798074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.798423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.807156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:25.807920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:25.808324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:25.808672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:25.809786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:25.809963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.811554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.836543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 341/661] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:25.837667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:25.880092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:25.882036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:25.932842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.968431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6646147-cd06-4e60-bf95-f81fc96ef2e2 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:25.990503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:25.996354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 321/662] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:25.997447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.015682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.016776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.017142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.017648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.024895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.026336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-2f4d292c-d428-435b-a3dc-8b78a6925ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:26.040670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:26.041562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:26.042458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 342/663] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:26.043423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4fb2-5c7e-4e7c-a7ab-5e7d67857989 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.043497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4fb2-5c7e-4e7c-a7ab-5e7d67857989 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.044042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4fb2-5c7e-4e7c-a7ab-5e7d67857989 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.049067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 343/664] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:26.049723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4fb2-5c7e-4e7c-a7ab-5e7d67857989 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.112365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3a03-8510-4c66-ac79-097e185e2e6f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.150067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3251ba-a833-4eb1-8f2e-22a1ed2e3733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.150753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3251ba-a833-4eb1-8f2e-22a1ed2e3733 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.151044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3251ba-a833-4eb1-8f2e-22a1ed2e3733 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.151321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3251ba-a833-4eb1-8f2e-22a1ed2e3733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.158645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4fb2-5c7e-4e7c-a7ab-5e7d67857989 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.168276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.200988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.201836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.202120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.202392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.213432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.214901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.225518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3251ba-a833-4eb1-8f2e-22a1ed2e3733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.227660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3251ba-a833-4eb1-8f2e-22a1ed2e3733 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:26.233408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:26.234603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:26.235566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:26.235566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:26.235566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:26.235566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:26.235566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 344/665] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:26.235839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.267697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.338797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 322/666] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:26.340162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.340454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.340731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.348115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290079-2351-4a02-b2d6-385a64efd98d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.359930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:26.361128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:26.387611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.388282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.388558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.388834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.389633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:26.390206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.391409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.405015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 345/667] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:26.405830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.412293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.441581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 323/668] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:26.441581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.506919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.518711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337e7f-424f-4b2b-b9dd-a9d7504125ff None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.551905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979fef-384e-46e1-8f64-553824d90df2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.554122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.554854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.555178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.555418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.556154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:26.556463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.557889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.574185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 346/669] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:26.574185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.598773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.599770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.600260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.600611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.615041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.617111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:26.640078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:26.641154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:26.642089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:26.642089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:26.642089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:26.642089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:26.642089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 324/670] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:26.642476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.675727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.679737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33f85-c990-42e8-838c-9dc779d7fd42 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.714850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.715507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.715786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.716315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.717151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=a7d5722330cc432ea6b3c4f505a78669) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:26.717467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.718913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.725266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 347/671] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/role_assignments?user.id=a7d5722330cc432ea6b3c4f505a78669&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:26.725954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.742470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.758371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7d2e2-4b8d-488f-bdd1-ec5a7813a399 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.800470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.801651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.802134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.802419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.815023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:26.823294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:26.824371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:26.825206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:26.829702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 325/672] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:26.830419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.848751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb63b6-1119-48bb-8c43-821496c5ffed None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.889703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.890732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.890842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.891100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.900333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.901806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-2dc9bdb6-0e49-496c-9f29-f4d521101a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:26.918084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:26.919036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:26.919935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 348/673] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:26.920868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48e9f-e9ca-4e81-877e-54cd7cd8800e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.920868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48e9f-e9ca-4e81-877e-54cd7cd8800e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.921093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48e9f-e9ca-4e81-877e-54cd7cd8800e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.922479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 349/674] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:26.923088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a48e9f-e9ca-4e81-877e-54cd7cd8800e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:26.934845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:26.948590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac26ec-e133-4ab4-8d6c-48c78d3abcea None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:26.987159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:26.987829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:26.988111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:26.988384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:26.989108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:26.989410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:26.990808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729bea7-9c58-42ce-a5c9-a7406b38dc7e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.002683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.008886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 326/675] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.008886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.008886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.008886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.024966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:27.026141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:27.034841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a48e9f-e9ca-4e81-877e-54cd7cd8800e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.072214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.072887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.073168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.073440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.074195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.074505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.075908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.089133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 350/676] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.089133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.112929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 327/677] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:27.116198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.209542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.210473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de950-64fc-4530-b1a9-4aaea9d3ba5f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.237260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b63f45-80ab-476a-b492-d53c48d1a55a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.248128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.250886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.250886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.250886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.250886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.251443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.253053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.255270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.272912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 351/678] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.272912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.280145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.280975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.281259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.281538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.288548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.290732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:27.304947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:27.306019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:27.306974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 328/679] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:27.307471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.377309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0154ae-3d2e-4b79-a6c2-b4d23c15632d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.416103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.416902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.417188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.417466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.417791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b76ee9-3ebf-4108-a80f-dcfecd941ae5 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.429338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.430932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:27.449834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:27.450790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:27.451712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:27.451712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:27.451712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:27.451712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:27.453575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.454373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.454654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.454947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.455763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 352/680] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:27.456605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.463641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.467855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:27.476337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:27.483261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 329/681] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:27.484280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.517477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.571350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa480-c930-46bb-8b20-e964739b4301 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.591326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04553d7-f08a-41f8-ac4a-a67bf895b99e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.607732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.608389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.608674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.608953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.609792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=992d129919be4586b6e1c9d1fed498b6) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.610104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.611576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.617430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 353/682] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/role_assignments?user.id=992d129919be4586b6e1c9d1fed498b6&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.618905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.638443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.639593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.639881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.640160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.640981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.641303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.642810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.657964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 330/683] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.663760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.737495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.760946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499a0cf-85d0-4a5f-b172-dd41c12d88ad None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.773577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:27.787478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da8ba0-ba3f-4a18-a144-9af81cb65f6b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.804551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.805824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.806320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.806559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.807761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.808310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.809901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.823646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 354/684] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.824517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.834047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.834751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.835041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.835321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.836131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.836445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.837808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:27.847164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 331/685] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:27.847775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:27.945056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66eb3-2cc2-4124-967b-e818ee66d29f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.989727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:27.990421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b545d1-083b-4f29-b4af-4899cc87c9ec None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:27.991136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:27.991632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:27.992422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:27.994400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=827c5b6ddf0b4e899dd0c2ab3e05b0d9) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:27.995046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:27.996732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.006150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 355/686] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/role_assignments?user.id=827c5b6ddf0b4e899dd0c2ab3e05b0d9&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:28.007239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.025583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:28.051520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:28.069492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.070299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.071227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.071505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.092116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.093835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:28.131252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:28.132680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:28.133669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 332/687] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:28:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:28.137811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134b847-2657-441a-92f4-4406ea14525b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:28.138104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.180853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.182208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.182727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.183233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.196311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.198224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:28.217459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:28.218478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:28.234288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:28.234288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:28.234288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:28.234288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:28.234288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 356/688] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:28.234288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.302815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f056-5237-4950-9e08-c738f5ed7267 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:28.350800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.350800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.350800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.351126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.351956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:28.352269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.354322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.363707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:28.381928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc8b6-5bf2-4e6d-bfe8-7ffe25eb7916 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:28.383547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 333/689] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:28.388983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.426818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.427915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.428375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.428848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.430365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:28.430852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.432649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.442484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:28.446492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 357/690] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:28.452484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.512776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674b49c-a8b7-4f6b-baf3-d2697d2c668e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:28.549457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.549880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.550164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.550439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.570161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3288e-53f2-4b4e-887f-24ae404fc329 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:28.609499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.610842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.611409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.611866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.621583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.622938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.623078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.624811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:28.641128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:28.642189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:28.643142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:28.645463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 358/691] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:28.654134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.661642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:28.689476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:28.796544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 334/692] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:28.803673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.817023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dea79b-6640-4384-afed-a7d031b91015 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:28.853510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:28.854298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:28.854589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:28.854889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:28.855746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:28.856057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:28.857493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:28.876758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 359/693] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:28.883388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:28.967435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.005314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cb595-0e08-49ee-800c-7f9349a01b67 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.046970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.047886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.048141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.048416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.062947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b8d56-ff42-44be-8de1-f851b50ffe1b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.104705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.105936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.106223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.106501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.115212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.121494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.123737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.140127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.141903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-3bd4bb3a-9f0b-4da8-8ce6-d7ece0aa6901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:29.145794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:29.147003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:29.148433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:29.148433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:29.148433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:29.148433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:29.148433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 335/694] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:29.148917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3ff1-d896-43af-aee2-720f67f89f58 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.149199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3ff1-d896-43af-aee2-720f67f89f58 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.149481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3ff1-d896-43af-aee2-720f67f89f58 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.151489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 336/695] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:29.157545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.157835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.158116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.181448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:29.183074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:29.217416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.255821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 337/696] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:29.257022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.269969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 360/697] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 10:28:29.276049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.368638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915bfeb-c7c3-498e-ae46-5ef95b0aa21d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.389806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.390815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbbf56-12c8-4f85-9399-7e944b7dd573 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.406222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.410023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.410023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.410023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.410023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:29.410023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.411011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.423801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 338/698] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:29.425032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.433881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.435049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.435563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.436033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.450377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.452260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:29.480018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:29.480969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:29.481850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:29.481850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:29.481850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:29.481850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:29.489065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 361/699] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:29.489808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.510189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.559216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315073aa-86c5-4a70-a23a-a9bf46c9fe5d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.598987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcba5d-10a4-4a57-8c12-50ceb17e044f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.599689 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.600805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.601374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.602490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.614771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.616646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.635741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.636539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.636819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.637092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:29.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:29.639266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:29.640152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:29.640152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:29.640152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:29.640152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:29.642501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 339/700] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:29.643506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.649535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.651041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:29.665809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:29.666853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:29.667761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:29.671723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 362/701] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:29.672557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.683528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.751993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.762145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa879-b34a-41aa-9703-8eb06fe0cacb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.776731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23c20-63ad-4ae5-b987-41c7b4d3cd30 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.808630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.809677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.810210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.810714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.811805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:29.812345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.814238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.815761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.816422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.816703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.816978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.817697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:29.818338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.819382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.833715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 340/702] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:29.834928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.836695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 363/703] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:29.837545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:29.937802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:29.940916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e287bb-894d-47eb-8191-7ec082b5e59e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.948067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9708dc2-3c6a-4230-82ff-5866c2f87d17 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:29.978035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8f77d-f1f9-4711-8bc9-7901142e3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.978729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8f77d-f1f9-4711-8bc9-7901142e3aef None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.979017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8f77d-f1f9-4711-8bc9-7901142e3aef None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.979296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8f77d-f1f9-4711-8bc9-7901142e3aef None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.979999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8f77d-f1f9-4711-8bc9-7901142e3aef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.981424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8f77d-f1f9-4711-8bc9-7901142e3aef None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.984136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:29.984794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:29.985075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:29.985347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:29.986133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:29.986446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:29.987991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:29.989397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:30.000431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 341/704] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:30.002049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.078044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 364/705] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:28:29 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:30.079699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32f7dc-fda5-4bd5-8f4c-4b66bf06143c None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.079993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32f7dc-fda5-4bd5-8f4c-4b66bf06143c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.080273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32f7dc-fda5-4bd5-8f4c-4b66bf06143c None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.081846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 365/706] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:30.082305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32f7dc-fda5-4bd5-8f4c-4b66bf06143c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.120592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71024-6233-4a9b-8aca-e76b01c8f160 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.161813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.163438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.163907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.164389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.172510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.174272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-a9a22e93-43f8-4d9f-a08c-18fab3318917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:30.191132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:30.192076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:30.192979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:30.200708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 342/707] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:30.202458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.202954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.203427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.222305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:30.224107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:30.230739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32f7dc-fda5-4bd5-8f4c-4b66bf06143c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.235078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:30.281082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.281082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.281082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.281453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.282605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0be525488dbf496cb0440dc4b046df85) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:30.282605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.284420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.292641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 366/708] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/role_assignments?user.id=0be525488dbf496cb0440dc4b046df85&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:30.293458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.307528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 343/709] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:30.330666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.381263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:30.440153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441562a-baf0-45f8-9e9f-ee3729484c45 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.482792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c618ecd-db7f-4a51-a37b-cdec7e60324b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.489021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.489711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.489999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.490279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.494647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:30.494647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.494647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.506984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 367/710] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:30.515741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.535948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.537095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.537497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.538102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.541205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.542925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:30.560472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:30.561799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:30.562956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 344/711] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:30.568387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.579388 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:30.632687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425ff3e-2401-480d-8813-94a1d40488d9 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.650565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:30.668778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.669436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.669715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.669987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.670949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=24ea97317d564485a0982fe7533561be) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:30.671263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.672707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4112-7677-4bd3-9f8d-84c689c64d83 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.686854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 368/712] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/role_assignments?user.id=24ea97317d564485a0982fe7533561be&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:30.688440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3195d-a406-416a-a83d-10a9c8e6b195 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.689119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3195d-a406-416a-a83d-10a9c8e6b195 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.689871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3195d-a406-416a-a83d-10a9c8e6b195 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.691311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b023be-b8e5-419d-98c4-037d83eefdf9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.691603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 369/713] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:30.697193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.697517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.697747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.728485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:30.729713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:30.734500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.735498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.736086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.736574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.737505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:30.738157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.739937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.746811 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 345/714] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:30.752621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.838563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:30.854025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 370/715] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 10:28:30.875496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce90bc-10dc-48a6-ae62-aa02148751ee None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:30.887829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:30.928511 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:30.929199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:30.929538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:30.929872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:30.930762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:30.930983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:30.932468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:30.942537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 346/716] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:31.008452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecbc8b-d1cd-4ff4-9a9b-86f6df5e972b None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:31.020988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:31.048426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:31.049257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:31.049545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:31.049827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] PATH_INFO: `/v3/services/network` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:31.050505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:31.051933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:31.067013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:31.068374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:31.069788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 371/717] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:30 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:31.074975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:31.191822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659ff96-e3e7-4573-956f-1d5075e546df None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:31.231152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:31.234529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:31.234529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:31.234529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:31.234529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] RBAC: Adding query filter params (name=network) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:31.234529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:31.235732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c89b2-c3bf-42a4-b352-2b32cc7189ab None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:31.237079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:31.242192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 347/718] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:31.247970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:31.438665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e39-2d8b-4d83-acd4-76caf91c2f54 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:31.475100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:31.475864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:31.476065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:31.476346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:31.477837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:31.478159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:31.479579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f28c59-31ce-4903-bd49-d04d180bc6d4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:31.485949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 372/719] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:32.775560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b593c-2ca0-45aa-a909-a154eef6eabc None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:32.776624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b593c-2ca0-45aa-a909-a154eef6eabc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:32.777128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b593c-2ca0-45aa-a909-a154eef6eabc None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:32.779041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 348/720] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:32.786715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43323-1a65-4774-a0f2-200cc5b9ee4a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:32.786715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43323-1a65-4774-a0f2-200cc5b9ee4a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:32.786715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43323-1a65-4774-a0f2-200cc5b9ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:32.808088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-35a43323-1a65-4774-a0f2-200cc5b9ee4a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:32.809273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-35a43323-1a65-4774-a0f2-200cc5b9ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:32.852729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:32.903656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 373/721] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:32.926420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b593c-2ca0-45aa-a909-a154eef6eabc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:32.976830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a39ff5-97a5-4ce8-aae3-69acb41989ae None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:32.977082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a39ff5-97a5-4ce8-aae3-69acb41989ae None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:32.977474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a39ff5-97a5-4ce8-aae3-69acb41989ae None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:32.978984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 374/722] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:32.985544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:32.985835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:32.986119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.023821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:33.025212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:33.077634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b593c-2ca0-45aa-a909-a154eef6eabc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.151875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 375/723] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:33.159399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.160518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.161039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.161532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.173248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:33.181997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:33.183236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:33.184069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:33.186627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 349/724] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:33.194291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:33.206986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:33.339171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:33.380962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:33.385807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf404-a260-4c7d-859b-56d5d274f515 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.401434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2695b-cedf-49f9-84e4-b1a350bb7382 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.431101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.431793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.432080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.432354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.433111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:33.433418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:33.434910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915525a8-7111-4a26-9c8f-4e1fd036cc99 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:33.444275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 376/725] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:33.446169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db4108-20e8-4999-9283-0aed9a4a92e2 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.446909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db4108-20e8-4999-9283-0aed9a4a92e2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.447705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db4108-20e8-4999-9283-0aed9a4a92e2 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.453077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 377/726] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:33.453077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db4108-20e8-4999-9283-0aed9a4a92e2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:33.453319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15a84-4cf6-45a7-8a70-08f0ff454c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.453319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15a84-4cf6-45a7-8a70-08f0ff454c76 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.453319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15a84-4cf6-45a7-8a70-08f0ff454c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.453319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15a84-4cf6-45a7-8a70-08f0ff454c76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.465418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d15a84-4cf6-45a7-8a70-08f0ff454c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-a3d15a84-4cf6-45a7-8a70-08f0ff454c76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:33.473913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:33.475092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:33.476155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:33.478779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 350/727] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:33.484799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.485193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.485575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.504099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:33.505533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:33.586728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 351/728] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:33.586728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:33.590148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db4108-20e8-4999-9283-0aed9a4a92e2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.630357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.631279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.631561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.631829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.640599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:33.643357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:33.644861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-3f8e3085-bdfe-41ee-bb5a-24ae7e1980b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:33.663307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:33.665128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:33.666035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:33.666035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:33.666035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:33.666035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:33.666035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 378/729] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:33.666642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9e478-1b81-44a6-ac4d-e69e5ec8b450 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.666833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9e478-1b81-44a6-ac4d-e69e5ec8b450 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.667092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9e478-1b81-44a6-ac4d-e69e5ec8b450 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.668625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 379/730] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:33.669315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9e478-1b81-44a6-ac4d-e69e5ec8b450 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:33.686721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:33.700850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9550586-2cc3-4f87-8cf6-f9da1dfa1fb2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.740107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.741078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.741683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.742161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.743850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:33.744172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:33.745680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:33.759108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 352/731] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:33.759108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:33.792017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9e478-1b81-44a6-ac4d-e69e5ec8b450 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.828674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.829362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.829650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.829929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.830651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:33.832061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:33.862788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31051e07-d71e-4704-b37a-bbd4d1cad53c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:33.873547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:33.896911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:33.897584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.897869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.898149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.898976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:33.899287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:33.900753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c22c8-e891-424e-9280-229da81c507e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:33.912648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 353/732] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:33.913900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:33.914236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:33.921772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:33.930928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:33.932113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:33.954889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 380/733] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:28:33 2022] POST /identity/v3/services => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:33.956053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.035256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 354/734] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:34.037178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.045960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.081933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754dbed-8a18-4739-a167-3d218f51f3c2 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.122553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.123658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.124752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.125026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.139856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.142014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.148971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.155521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d37e69-ae0c-4dce-a29e-30e91105df95 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-774b633e-54b5-4805-a02e-e0f210646cfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:34.159568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:34.160496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:34.161404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:34.161404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:34.161404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:34.161404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:34.161404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 381/735] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:34.162609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21351f-ba7f-435b-b39d-fb8bc01ee7ee None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.162609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21351f-ba7f-435b-b39d-fb8bc01ee7ee None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.162609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21351f-ba7f-435b-b39d-fb8bc01ee7ee None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.165962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 382/736] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:34.165962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21351f-ba7f-435b-b39d-fb8bc01ee7ee None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.194625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.195531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.195819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.196095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.203362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.204820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-27d456b1-f870-4ed8-bc85-201b2f34512d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:34.219333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:34.226221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 355/737] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.228097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.229067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.244297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:34.245597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:34.279256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21351f-ba7f-435b-b39d-fb8bc01ee7ee None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.303687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.315733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.316529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.316815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.317141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.320005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 356/738] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 10:28:34.320005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.336114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:34.345348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:34.346498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:34.347582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:34.354851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 383/739] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:34.355882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.417211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.434152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8b3f-fcb3-4bb0-a9f9-aa76a806a544 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.466013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321e0e3-4d2a-4f16-b8ae-0767fff74dba None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.474112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.474813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.475102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.475381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.476114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:34.476426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.478321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.496572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 357/740] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:34.497422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.503057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.503742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.504027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.504300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.505152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:34.505465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.506926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.525563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 384/741] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:34.526203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.570953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.611671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920dbd6-b186-4371-ae20-79742632f819 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.636805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b1858-0d36-457a-8713-7a142ebdd190 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.646783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.647448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.647725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.648006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.648794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.650352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.671679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.672278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.672559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.672832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.673577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:34.673882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.675343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.684057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 385/742] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:34.684820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.737971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 358/743] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:28:34 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:34.751726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.787106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.804988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971113-4f87-4c4b-b541-e84bf56672c6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.808345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:34.860537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.861361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.861642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.862488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.873272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.875071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.894513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee4ec-daf5-45a5-9751-6d6024a47d59 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:34.895179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:34.896262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:34.897250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 386/744] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:34.897864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:34.949364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:34.950440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:34.951064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:34.951493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:34.965952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:34.967664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:34.986044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:34.987034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:34.987921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:34.987921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:34.987921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:34.987921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:34.990279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 359/745] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:34.991286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.013416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756b966-88d9-4ee6-b221-30f0f9f64453 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.050589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.051620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.051948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.052290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.064249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.065802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.066901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:35.085777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:35.087444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:35.088440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:35.088440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:35.088440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:35.088440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:35.088440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 387/746] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:35.089440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.113656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.125239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8621f-2156-412d-b391-47850fe57b4c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.175758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.177611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.178088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.178563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.179641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:35.180168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.181945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.207206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 360/747] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Jul 21 10:28:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:35.208128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.213914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371f873-65b3-4fd9-b8cb-e3b60e1b6c88 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.260070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.261303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.261770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.262352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.263603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:35.264096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.265650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.284582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 388/748] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:35.285688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.328392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a66f-fe63-44b4-ac0d-16cb54f6dde7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.346720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.366777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.368084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.368488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.368824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.369781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:35.370157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.371807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.375461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.392437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 361/749] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:35.399263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.410453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24145b3d-ed2d-48c4-93fd-9e4d1cd5244d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.453754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.454781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.455135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.455481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.511124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a118f-52d5-4602-a5da-c643878c5cbc None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.538002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.540453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.551257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.552188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.552573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.553153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.561033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.562610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:35.579280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:35.580395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:35.581515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:35.588302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 362/750] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:35.588302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.622778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.625424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.662974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 389/751] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:28:35.663889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.694787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e76a15-d170-4363-a226-139cd1f46119 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.734019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.735190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.735679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.736176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.744255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.746070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:35.762557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:35.763580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:35.764526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:35.767380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 363/752] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:35.768399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.774474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a1df-e951-45f0-9771-8268e349b41c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.812313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.813052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.813321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.813606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.814470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:35.814859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.816462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.834899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 390/753] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:35.835576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.869147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.877897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:35.884854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419c8c-f04e-4296-83d3-cfface816f98 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.924778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.926546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.927250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.927682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.942979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.944692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:35.944839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676eab-8fef-483d-8cd3-845e25f17156 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:35.971317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:35.972456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:35.973829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:35.973829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:35.973829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:35.973829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:35.976430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 364/754] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:35.977868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:35.991125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:35.992007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:35.992455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:35.992854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:35.993820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:35.994250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:35.995818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.020489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 391/755] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Jul 21 10:28:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:36.021382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.113634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a660a7-9fb3-4f69-8883-cbc4330775f5 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.120600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.130508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b33a9-3b92-4c46-9e05-07ef1ea46506 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.150492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3280-62c8-445e-8fb6-51e248ad0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.151426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3280-62c8-445e-8fb6-51e248ad0787 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.151712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3280-62c8-445e-8fb6-51e248ad0787 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.151988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3280-62c8-445e-8fb6-51e248ad0787 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0be525488dbf496cb0440dc4b046df85/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.154432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3280-62c8-445e-8fb6-51e248ad0787 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=0be525488dbf496cb0440dc4b046df85, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.155915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3280-62c8-445e-8fb6-51e248ad0787 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.166515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.167204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.167486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.167757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.168474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:36.168838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.170187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.181767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 392/756] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:36.182541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.223115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 365/757] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:35 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0be525488dbf496cb0440dc4b046df85/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:36.224718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a084b-91b9-4892-a2a4-01f534583d55 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.225010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a084b-91b9-4892-a2a4-01f534583d55 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.225289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a084b-91b9-4892-a2a4-01f534583d55 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.226819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 366/758] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:36.227499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a084b-91b9-4892-a2a4-01f534583d55 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.259025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.304710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aff69-241d-48c1-bb55-bca7636fed77 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.360150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.361518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.362021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.362683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.387419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a084b-91b9-4892-a2a4-01f534583d55 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.390749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.428734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.430120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.430668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.431186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.438947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.440743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.453264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.454747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-37ece495-551a-4622-ad54-876b2812b74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:36.458224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:36.459105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:36.459992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:36.463233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 367/759] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:36.464774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.465266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.465722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.485213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:36.486872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:36.555595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.562185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 368/760] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:36.571692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.588376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 393/761] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:28:36.593530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.659555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.690957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5fe83-afc1-4a81-a8e9-6828447ee104 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.731020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ccb76-7069-4249-99b9-3b9c62df08f6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.734211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.735073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.735522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.735958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.736897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:36.737350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.739006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.752420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 369/762] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:36.753536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.770298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.771396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.771781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.772159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.783669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.785643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:36.809369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:36.810442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:36.811354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:36.811354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:36.811354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:36.811354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:36.816917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 394/763] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:36.816917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.827098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.868600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c9520-ff12-4501-9ac9-da2bc0b2c8f0 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.904788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.905964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.906445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.906944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.908089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.910964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:36.925880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:36.927434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:36.928258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:36.929067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 370/764] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:36.929658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:36.941456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f866d-4bda-4411-b64d-3fdd2b861a8c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:36.943497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:36.982174 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:36.983014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.983295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.983569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.984413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=9fe49b9d7762442aa250c9686d5bfce7) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:36.984724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:36.986149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da221d5-e063-48ab-ae9c-483842056727 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:36.998726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 395/765] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/role_assignments?user.id=9fe49b9d7762442aa250c9686d5bfce7&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:36.998726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb7704-be56-4482-af83-5016876eb008 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:36.998726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb7704-be56-4482-af83-5016876eb008 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:36.998726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb7704-be56-4482-af83-5016876eb008 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:36.998726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 396/766] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:36.998726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb7704-be56-4482-af83-5016876eb008 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.062508 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd259e81-5c38-447f-841e-685542a1cdba None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.088977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.101845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.102519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.106771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.106771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.106771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.106771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.106771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec4a5f-002c-4f25-8026-45162290476f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.123103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 371/767] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:37.124604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.124890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.125167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.145983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:37.147233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:37.150938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb7704-be56-4482-af83-5016876eb008 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.192462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.193519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.194029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.194545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.196304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.197673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.199378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.206316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 397/768] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 21 10:28:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:37.210871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.244573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 372/769] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:37.245787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.263286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.349327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d232a61-8b55-45b5-83c7-59ce2c9a40f8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.365642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe37d4-12aa-401f-8571-f6da81263b60 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.380383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.385822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.386659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.387036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.387379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.394709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.396353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.404919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.405854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.406376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.406892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.407861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.408356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.409930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:37.412548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:37.413436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:37.414394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:37.418736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 373/771] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:37.418736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.418956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 398/771] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:37.420368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.535992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.541496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99897d3c-f3f0-4072-96e9-a24bafc51254 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.549541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a230fd-9e47-467a-8830-82839893f404 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.581928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.583161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.583597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.584018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] PATH_INFO: `/v3/services/network` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.584786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.585014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.585655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.586533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.587031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.587665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.588224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.588652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.590444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:37.603109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:37.604328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:37.605383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:37.607883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 374/772] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:37.608855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.610834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 399/773] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:37.619010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.660217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.724919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c25d5b-fd42-4138-a0a4-de7cfec1843c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.759298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08249-e640-4452-86b8-46306e32ee10 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.762938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.763599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.763881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.764154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.764948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] RBAC: Adding query filter params (interface=public, service_id=126e6e110c7c44c5b66fc2bcf6681401, region_id=RegionOne) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.765256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.766748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.786395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 375/774] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/endpoints?service_id=126e6e110c7c44c5b66fc2bcf6681401&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:37.787435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.802706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.803917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.804387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.805115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.806480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] RBAC: Adding query filter params (name=network) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.807023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.809085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.815844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 400/775] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:37.816839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.837297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.911216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ed719-1ecd-4810-8017-2dbb3e24c87d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.914742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:37.950139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.950833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7705-eb21-4116-af59-9e0d533faa67 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:37.951686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.952221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.952672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.955051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=24ea97317d564485a0982fe7533561be) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:37.955521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.957276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:37.969933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 376/776] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/role_assignments?user.id=24ea97317d564485a0982fe7533561be&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:37.971199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:37.992226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:37.993481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:37.993764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:37.994238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:37.995015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:37.996468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:38.008131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 401/777] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:38.132043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfeda9-904f-401d-bde3-fccde446b3d3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:38.186819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:38.186819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:38.186819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:38.186819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:38.187246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:38.187246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:38.187246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:38.197898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 377/778] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:38.199810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:38.294934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:38.316860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb950d-0d98-4b60-bea8-bbdadb1c1249 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:38.354840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:38.355519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:38.355798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:38.356068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:38.356872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] RBAC: Adding query filter params (interface=public, service_id=fd4184ef0fb3404a9f1f8ca5b0f9de16, region_id=RegionOne) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:38.357183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:38.358555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0261d3c-73d4-4ad1-b144-1bbf528d15db None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:38.366780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 402/779] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:28:38 2022] GET /identity/v3/endpoints?service_id=fd4184ef0fb3404a9f1f8ca5b0f9de16&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:38.372504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:38.414861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:38.517333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6091273-5b23-467a-92b2-d092634c5da2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:38.549684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8f541-0233-4bd8-baf3-3504a1fa1c44 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:38.550021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8f541-0233-4bd8-baf3-3504a1fa1c44 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:38.550238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8f541-0233-4bd8-baf3-3504a1fa1c44 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:38.552781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 403/780] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:38.559082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:38.559502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:38.559743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:38.562029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:38.562952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:38.563435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:38.563906 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:38.564801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:38.566350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:38.573597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 378/781] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:28:38 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:38.592042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:38.593319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:38.686985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 404/782] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:38.736232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:38.841550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:38.847612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e314b-4773-4ce3-b6a7-b125ff94973d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:38.888815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:38.889716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:38.890007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:38.890284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:38.901563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:38.909417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:38.910335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:38.911217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 379/783] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:38.918535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:39.023638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:39.067466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1df035-ea4d-45f5-9f1b-68715ef31efc None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:39.114407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:39.115106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:39.115388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:39.115664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:39.116418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:39.116723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:39.118737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a00fb-1dc4-4bf1-95f8-c0f9d567ae92 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:39.130114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 405/784] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:39.136754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:39.370664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713bb0c-aed7-40ce-9d28-6fb7ab6b4138 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:39.371057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713bb0c-aed7-40ce-9d28-6fb7ab6b4138 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:39.371245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713bb0c-aed7-40ce-9d28-6fb7ab6b4138 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:39.372526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 406/785] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:39.379214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:39.379564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:39.379852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:39.407966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:39.409175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:39.417230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef1ae-1587-42ae-bda0-46ec63a61323 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:39.477935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:39.478813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:39.479101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:39.479373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:39.499987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:39.501476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:39.536135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:39.538247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:39.540669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:39.540669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:39.540669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:39.540669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:39.540669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 380/786] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:39.546548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:39.551614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 407/787] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:39.565221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:39.579966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:39.689173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:39.743054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23738-711d-461f-a9af-8669f5037ce2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:39.783517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f7c0-ab53-4723-9e09-c4a70151dce8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:39.791424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:39.792232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:39.792512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:39.792784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:39.809033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:39.816850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:39.817749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:39.818596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:39.833994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 408/788] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:39.834880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:39.862716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:39.862716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:39.862716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:39.862716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:39.863106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:39.863106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:39.863491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:39.877135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 381/789] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:39.881952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:39.983218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.044776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033ce7-93ea-4c55-a294-fa7c149160ff None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.068672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c0e9-8067-4999-ac00-0fadbcc6a0bf None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.070930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.082173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.082889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.083159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.083435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.084186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:40.084489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.085869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.096001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 409/790] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:40.101309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:40.126000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.127194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.128827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.129306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.141982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.145498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:40.175088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:40.176112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:28:40.177068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:40.184845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 382/791] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:28:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:40.185975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:40.278327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9f26d-86b1-4cd1-bd33-e8daac568bf8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.311860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.312655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.312936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.313211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.324874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.326389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:40.347071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:40.348250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:40.349584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:40.349584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:40.349584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:40.349584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:40.349584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 410/792] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:40.359720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:40.398780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260ed2b-b67e-425b-b756-606de727ceb8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.403204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.463829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.469605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead571df-9426-42fc-8456-4e4789104084 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.485137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.485824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.486109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.486423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.487257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:40.487569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.489013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.513627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.514745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.515227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.515699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.516641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:40.517143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.519240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.525811 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 383/793] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:28:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:40.540431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 411/794] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:40.543624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:40.547611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:40.699523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.703177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c1a0-f408-4129-ab97-0a53d5863458 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.707611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ea571-d048-46f4-a8bc-640579407db7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:40.743495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.743728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3a31-53c9-4070-9410-58022d7c5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:40.744145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3a31-53c9-4070-9410-58022d7c5653 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.744387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.744486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3a31-53c9-4070-9410-58022d7c5653 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.744674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.744769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3a31-53c9-4070-9410-58022d7c5653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.744949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.752861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.754307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-03b8f9d7-51e1-42e4-8d75-2abdcda9f113 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:40.770349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:40.771389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:40.772304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 412/795] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:28:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:40.772887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496292ab-f0b7-45f3-b159-4e6553a33c95 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.776910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496292ab-f0b7-45f3-b159-4e6553a33c95 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.776910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496292ab-f0b7-45f3-b159-4e6553a33c95 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.781423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 413/796] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:40.781423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d9d0-69ad-4986-9a27-779e93391196 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.781423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d9d0-69ad-4986-9a27-779e93391196 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.781423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d9d0-69ad-4986-9a27-779e93391196 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.782327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 414/797] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:40.783475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.783769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.784045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.802798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:40.804035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:40.825423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.839733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec3a31-53c9-4070-9410-58022d7c5653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:40.841353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec3a31-53c9-4070-9410-58022d7c5653 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:40.883031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 415/798] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:40.884393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:40.955610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 384/799] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:28:40.955610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:40.955610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:40.955610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:40.970665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:40.971895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:40.984912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:40.997173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be1db-33ac-4b41-b5e6-2e891c69aa76 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.031355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.032032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.032317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.032597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.033455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:41.033770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.035243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac803b-0ee7-452e-8bb9-4aa31d39c6e5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.037902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 385/800] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:41.038756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.054742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 416/801] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Jul 21 10:28:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:41.056392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aaa1a-0179-471e-ae69-f5e7b225aeb9 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.056678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aaa1a-0179-471e-ae69-f5e7b225aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.056948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aaa1a-0179-471e-ae69-f5e7b225aeb9 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.057659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.058182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 417/802] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:41.059268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aaa1a-0179-471e-ae69-f5e7b225aeb9 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.146478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af1b5a-799a-44a4-bc28-95fb61f46a30 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.183527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.184362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.184645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.184919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.185587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.187024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:41.199992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:41.201119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.201972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 386/803] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:41.202846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.276044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aaa1a-0179-471e-ae69-f5e7b225aeb9 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.286751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.306506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf42c9-ea61-479b-8bf5-bc6f8d37cf37 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.310265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.311076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.311355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.311629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.321640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.323091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.329862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.340022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.340827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.341156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-39d06be9-bee7-4e08-8e87-915ce3091515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:41.341356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:41.342401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:41.343403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:41.343403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:41.343403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:41.343403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:41.343633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.343710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 418/804] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:41.344025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.344306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.344577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.357120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.358573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.361892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:41.363111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:41.376815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:41.377702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:41.378579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:41.378579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:41.378579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:41.378579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.378855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 387/805] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:41.379662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.430998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 419/806] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:41.431863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.478899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1718-3971-43a4-a15d-dab54d29a8c2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.506798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.511641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.512429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.512711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.512990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.522801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:41.531037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:41.532123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.532964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 388/807] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:41.533993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6fc75-4833-4628-9caa-f801e040a7da None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.534078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.563170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.571082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.571739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.572023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.573129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.573129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:41.573291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.574636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.579359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 420/808] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:41.580118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.638076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3dd42-5cbc-44f6-b901-d7ad9fb55fe3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.672018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834040df-7012-441b-852b-6063c21b3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.672783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834040df-7012-441b-852b-6063c21b3601 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.673137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834040df-7012-441b-852b-6063c21b3601 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.673478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834040df-7012-441b-852b-6063c21b3601 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.674209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834040df-7012-441b-852b-6063c21b3601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:41.674516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834040df-7012-441b-852b-6063c21b3601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.675905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834040df-7012-441b-852b-6063c21b3601 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.681814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca124-8d97-4ed2-a988-59e53749f59c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.687613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 389/809] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:41.688410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834040df-7012-441b-852b-6063c21b3601 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.716628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.717285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.717563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.717845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.718556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:41.718890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.720245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.731832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 421/810] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:41.732599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.740773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.788386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.790020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834040df-7012-441b-852b-6063c21b3601 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.824339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.825066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.825351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.825635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] PATH_INFO: `/v3/services/network` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.826295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.827695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.834055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ae67-ec7d-4519-8164-b44736df8529 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:41.839921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:41.840888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:41.841716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 390/811] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:41.842498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.871951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.872616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.872904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.873181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.873931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:41.874239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.875633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.885847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 422/812] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:41.886721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.941399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f45d9-b0ed-4256-8c10-bac7baccba47 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:41.957508 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:41.976237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:41.977596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:41.977877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:41.978151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:41.978935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:41.979280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:41.980637 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:41.989810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 391/813] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:41.989810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:41.990027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df6266-4c34-4125-b86f-b98cabc02cdc None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.004207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.024011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.024917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.025200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.025478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.032056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.033489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:42.047920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:42.048898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 423/814] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:42.049832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.094032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b69ef-9385-4162-93f7-529fdaebdb21 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.127356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.128142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.128419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.128695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.136400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.137822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.148976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ccdbf-b436-4d73-8ab2-c95cb1cf009a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:42.153036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:42.154302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 392/815] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:42.155383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.194314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.195012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.195296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.196235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.196956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] RBAC: Adding query filter params (name=network) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:42.197265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.197640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.198627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.203114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 424/816] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:42.203857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.244812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.256509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076165a-16e5-4e2f-894f-4dde705dbd9c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.291055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.291843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.292126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.292401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.302272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.303808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.305306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1e7a-3e74-43cd-aa79-a4a76173cf6d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:42.321238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:42.322249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:42.323394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:42.323394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:42.323394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:42.323394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:42.323394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 393/817] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:42.323394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.340907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.341569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.341859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.342140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.342917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.344336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.414640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.422930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab418236-57ed-4841-b42d-ec2b58eacc7c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.431562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 425/818] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:28:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:42.432454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.467037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.467724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.468034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.468857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.469700 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:42.470022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.471581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.491455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 394/819] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:42.491455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.556352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.563988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a06ee5-56e4-4f34-8611-e1172d511cd0 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.601768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.602512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.602905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.603225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.604008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:42.605036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.606068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.609776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232003-84c7-4820-98bc-7404ae697f62 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.620119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 426/820] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:42.620119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.649314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.650079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.650429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.650803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.651584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] RBAC: Adding query filter params (type=network) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:42.651983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.653407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.662769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 395/821] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:42.662769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.676946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.736498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c8764-84cc-431d-9bfe-8642c36a7201 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.769675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f045-3620-4861-b53d-860e75501f51 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.776518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.777324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.777702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.778515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.779385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:42.779814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.781283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.794938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 427/822] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:42.800276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.812384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.813134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.813488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.813830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.814777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0be525488dbf496cb0440dc4b046df85) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:42.815250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.816661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:42.818342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.834731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 396/823] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:42 2022] GET /identity/v3/role_assignments?user.id=0be525488dbf496cb0440dc4b046df85&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:42.834731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:42.933181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207ea3-7d8e-4d63-b23c-98be3bdde95d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.937996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:42.972314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b4246-d528-4797-abf6-e458d85457f7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:42.977961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:42.978436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:42.978740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:42.979018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/9fe49b9d7762442aa250c9686d5bfce7/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:42.996964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=9fe49b9d7762442aa250c9686d5bfce7, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:42.998412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.014170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:43.014869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:43.015302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:43.015532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:43.016274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:43.017629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.075223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 428/824] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:42 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/9fe49b9d7762442aa250c9686d5bfce7/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:43.075927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:43.105001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 397/825] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:28:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:43.166627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:43.219786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c4283-a184-4619-a7e5-d98b3adf98a6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:43.276074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:43.276891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:43.277170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:43.277439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:43.287491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:43.289053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:43.308963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:43.310003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:43.310980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 429/826] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:43.316400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:43.428325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b6e49-1c59-46c2-ad03-3da481536799 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:43.462037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:43.469230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:43.469973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:43.470206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:43.470490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:43.471409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:43.471723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:43.473155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.493280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 398/827] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Jul 21 10:28:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:43.499805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:43.615816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3861-7b57-4493-8b88-9ea0783c83e8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:43.640294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:43.655488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:43.656297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:43.656585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:43.656863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:43.668177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:43.669643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:43.689120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:43.690056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:43.691225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:43.691225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:43.691225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:43.691225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:43.691225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 430/828] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:43.697280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:43.801984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee9303-9b53-4572-91e5-0a7609e0e805 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:43.838365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:43.839062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:43.839349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:43.839628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:43.840354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:43.840663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:43.842021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:43.856120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 399/829] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:43.860328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:43.964047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadb46f-1953-4727-94ef-8471dd4e31a9 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:43.999546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:44.000340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.000622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.000897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.007743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:44.009760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:44.024510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:44.025506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:44.026827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 431/830] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:44.031762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:44.115172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:44.137015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb5cee-26f3-41f7-bfd0-361d7e6e0abe None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:44.171881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226808-87c5-4085-a870-734048f18267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:44.172558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226808-87c5-4085-a870-734048f18267 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.172842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226808-87c5-4085-a870-734048f18267 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.173120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226808-87c5-4085-a870-734048f18267 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.173919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0226808-87c5-4085-a870-734048f18267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:44.174230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0226808-87c5-4085-a870-734048f18267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:44.175697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0226808-87c5-4085-a870-734048f18267 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:44.189973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 400/831] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:44.196668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:44.236084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:44.311147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b17a8-96d1-4268-a3c2-17ec8695c2fb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:44.349301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd86543-0c9e-420e-b944-0954095b4ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:44.350191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86543-0c9e-420e-b944-0954095b4ee0 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.350475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86543-0c9e-420e-b944-0954095b4ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.350773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86543-0c9e-420e-b944-0954095b4ee0 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/24ea97317d564485a0982fe7533561be/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.352834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd86543-0c9e-420e-b944-0954095b4ee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=24ea97317d564485a0982fe7533561be, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:44.354285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd86543-0c9e-420e-b944-0954095b4ee0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:44.422007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 432/832] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:44 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/24ea97317d564485a0982fe7533561be/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:28:44.566556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a1ba-9f28-49cd-9e66-34d237ab8b6b None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.567133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a1ba-9f28-49cd-9e66-34d237ab8b6b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.567133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a1ba-9f28-49cd-9e66-34d237ab8b6b None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.568734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 401/833] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:44.575200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.575468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.575753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.593227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:44.594425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:44.667035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 433/834] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:44.686295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a1ba-9f28-49cd-9e66-34d237ab8b6b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:44.792160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a1ba-9f28-49cd-9e66-34d237ab8b6b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:44.803312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:44.827348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:44.828148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.828432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.828708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.829369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:44.830951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:44.844115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:44.845140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:44.846409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 402/835] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:44.851845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:44.876145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:44.955251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c00f3-5bd0-44c6-b869-e83b19800f2e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:44.991032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:44.991748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:44.992030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:44.992860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:44.994042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:44.994352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:44.995776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e090cd-2a4b-4602-993d-1646dc01caf8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:45.000942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 434/836] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:45.006553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:45.112588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7c3c-b197-4366-a0bd-926d041c20b1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:45.147603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:45.148284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.149133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.149376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.150191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:45.150498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:45.154895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eca4f-3186-4457-9c36-c5665ae15292 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:45.158999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 403/837] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:45.189862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd166c2-bdab-474f-90dc-bf83bf2e28ce None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.190159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd166c2-bdab-474f-90dc-bf83bf2e28ce None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.190438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd166c2-bdab-474f-90dc-bf83bf2e28ce None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.192187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 435/838] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:45.204687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.205226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.205717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.225773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:45.227660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:45.265065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:45.307985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 404/839] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:45.331215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd166c2-bdab-474f-90dc-bf83bf2e28ce None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:45.432550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:45.449542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd166c2-bdab-474f-90dc-bf83bf2e28ce None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:45.487021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:45.488132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.488602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.489061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.489922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:45.491509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-6bf88923-bcac-4584-969f-865ac91bc37f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:45.505394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:45.506404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:45.507273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:45.510081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 436/840] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Jul 21 10:28:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:45.516185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:45.521052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c5b48-fa9b-445b-b8de-6ef1cb866879 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.521534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c5b48-fa9b-445b-b8de-6ef1cb866879 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.521980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c5b48-fa9b-445b-b8de-6ef1cb866879 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.523512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 437/841] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:45.530266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.530554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.530878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.548539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:45.549727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:45.630709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 438/842] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:45.644237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbf689-5019-443f-aa82-3371d1c5f4b7 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:45.650389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:45.682994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:45.683659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.683937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.684207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.684917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:45.685219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:45.686568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:45.697409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 405/843] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:45.703880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:45.740076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:45.762902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:45.794958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a9905-78bf-45a2-87a0-2bd959c7c5ea None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:45.824320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded4610-12db-445d-a3ef-abcc53ffcc2d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:45.839294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:45.840106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.840389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.840661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.856042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:45.864564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:45.865476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:45.866020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:45.866234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:45.867179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:45.868538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 439/844] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:28:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:45.874556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:45.874556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:45.874556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:45.874556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:45.874903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:45.886645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 406/845] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:45.990469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06694-1a0e-4c1b-aef4-bef41d506b37 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.028843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.029524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.029811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.030084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.030884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:46.031193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:46.032989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:46.042363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 440/846] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:28:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:46.048365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:46.147074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:46.152960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b815e-46c4-4cc2-b150-26a705a0764a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.188853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab228f-4107-4362-878a-85df10837603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.189701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab228f-4107-4362-878a-85df10837603 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.189998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab228f-4107-4362-878a-85df10837603 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.190282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab228f-4107-4362-878a-85df10837603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.201250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab228f-4107-4362-878a-85df10837603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:46.202715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab228f-4107-4362-878a-85df10837603 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-7eab228f-4107-4362-878a-85df10837603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:46.220755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:46.221691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:46.222588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:46.222588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:46.222588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:46.222588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:46.222588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 407/847] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:46.230280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:46.233589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:46.348120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded92e83-b8a3-42a1-9c0f-69f87a1d63b3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.382756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.384053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.384349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.384609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.385338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:46.385644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:46.387034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:46.401370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 441/848] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:46.406856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab228f-4107-4362-878a-85df10837603 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:46.516328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab228f-4107-4362-878a-85df10837603 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.551773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.552605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.552878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.553155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.560422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:46.561923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-277a26d0-678b-4d2c-bcda-7b0eaad39455 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:46.577959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:46.582445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:46.583436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 408/849] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:46.585065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:46.656774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:46.677303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2a78-dbbf-4255-8b35-9fe5fdb4ab2e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.678283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2a78-dbbf-4255-8b35-9fe5fdb4ab2e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.678822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2a78-dbbf-4255-8b35-9fe5fdb4ab2e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.681404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 409/850] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:46.686828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.687368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.687872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.697097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de75a3-ea3e-4687-a799-b97bce1ef9d4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.705821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:46.707303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:46.709709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:46.733826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.734509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.734842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.735124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.735984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:46.736298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:46.737737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:46.756420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 442/851] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:46.763309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:46.790945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 410/852] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:46.809421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:46.892009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a408b-cd4d-43ed-ab68-40e4e6e3ca6a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.920903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:46.922315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001ac3a-52c3-467c-bceb-38b8a7b24046 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:46.938655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.939710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.940069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.940424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.963570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:46.964736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:46.965357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:46.965937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:46.974128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:46.978757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:46.987592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:46.988678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:28:46.989514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:46.997239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 411/853] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:46.998412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.029185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.030950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.122361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d351f4-26ee-42da-b20c-483690ca8b17 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.158866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 443/854] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:28:47.165364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.170863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.171724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.172048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.172422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.173740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:47.174148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.176010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.188622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 412/855] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:47.189827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:47.199216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.277642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:47.277844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300f96b-43c1-4842-b75f-61ff4a1e1b09 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.314285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.315109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.315398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.315673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.326502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.328070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.328196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3dde-62c8-4886-8e80-2ed2f0f68f8e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-c913cf40-618c-4682-9271-1c768675b25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:47.345409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:47.346291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:47.347220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:47.347220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:47.347220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:47.347220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:47.347220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 444/856] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:47.348152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54790662-c8dd-4d51-980b-aa0595b1993d None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.348152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54790662-c8dd-4d51-980b-aa0595b1993d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.348779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54790662-c8dd-4d51-980b-aa0595b1993d None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.349995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 445/857] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:47.355069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.355357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.355632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.370517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.371590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.372062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.372527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.372667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:47.373830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:47.384061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.385695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:47.404566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:47.405466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:47.406409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:47.406409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:47.406409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:47.406409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:47.410453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 413/858] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:47.411314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.452138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 446/859] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:47.463650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.467118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:47.525722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92759fd-5363-46b2-ad20-ad401f19b796 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.539043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:47.561698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.562367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.562654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.562972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.563756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:47.564074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.565434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.583376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 414/860] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:47.583376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.590717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7fe02-2778-4e46-aad6-01df71558984 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.629152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.629879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.630153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.630434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.631248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:47.631555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.634019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.650315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 447/861] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:47.651213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.688618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb78e-f9f0-4e50-95a5-f82ecb7f1018 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.718547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:47.727538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.733407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.733407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.733407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.733407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.733407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.759416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1793-190b-4231-8ad9-fb4f9ac318e5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.796277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:47.797073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:47.797353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:47.797628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:47.804237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:47.805734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:47.815738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 415/862] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:28:47 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:47.816561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:47.822382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:47.823542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:47.824462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:47.831727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 448/863] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:47.835285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:47.868752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:47.967148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862e4f4-614e-4c7f-958b-95ab23f4e88f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:47.981051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21c0f-259e-4840-9fa6-c64d1ecf4f2b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.009084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:48.012425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.013247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.013528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.013793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.023175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.023839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.025009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.025009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.025192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.025377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.025847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:48.026158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.027618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.041109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 449/864] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:48.046155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:48.047441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 10:28:48.048815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:48.049557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:48.049642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 416/865] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:28:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:48.056201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:48.153170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:48.166354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9858ff-fe55-405e-9626-7271e0d3ba22 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.169011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce35e3d-7158-425c-9b57-2abbd7cbbe92 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.201997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.202665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.203008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.203244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.204090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:48.204404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.205907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.206509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.207232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.207521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.207793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.208641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=9fe49b9d7762442aa250c9686d5bfce7) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:48.208950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.210479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cccf8f-fb80-4c38-b21f-5ad52f9ba400 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.217107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 450/866] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:48 2022] GET /identity/v3/role_assignments?user.id=9fe49b9d7762442aa250c9686d5bfce7&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:48.218368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad038f-58b9-4c93-a207-44449af80e68 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.218662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad038f-58b9-4c93-a207-44449af80e68 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.218968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad038f-58b9-4c93-a207-44449af80e68 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.222737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 451/867] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:48.226119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.226630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.227384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.236097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 417/868] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Jul 21 10:28:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:48.237083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:48.248404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:48.250511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:48.310884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:48.352879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 452/869] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:48.359884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468bdec-c10d-4c54-adaf-9dff9be2c629 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.376706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:48.405612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.406275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.406616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.408147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.427673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:48.498423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.500283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.516119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef86f7-abac-4643-912e-23da33b97147 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.562482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.563239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.563519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.563793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.564573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.566466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.617185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 418/870] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:48 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:28:48.624018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:48.649942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 453/871] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:28:48 2022] POST /identity/v3/services => generated 269 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:28:48.688702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:48.756478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ae89-d110-4d56-8c6f-26aef7b03b33 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.803158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.803974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.804259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.804536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.816826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.818293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:48.837105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:48.838100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:48.839107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:48.839107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:48.839107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:48.839107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:48.842817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 419/872] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:48.844372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:48.894589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:48.955339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416ecf7-d9d3-49ee-b886-2d27774fc1a5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:48.990865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:48.991534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:48.991813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:48.992088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:48.993503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:48.993811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:48.995202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:49.007889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 454/873] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:49.015766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:49.116303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:49.123422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a47e47-c395-4909-aaa8-54c6f1d25107 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:49.158519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:49.159346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:49.159627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:49.159900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:49.167319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:49.169391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:49.183437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:49.184406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:49.185339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 420/874] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:49.191096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:49.295620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:49.301582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8226ac-ff7b-40e4-96ec-ba3b152982f6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:49.336056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:49.336884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:49.337164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:49.337445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:49.338229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:49.338538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:49.339993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d159263-fe5a-4204-98ac-f1f2c92dabde None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:49.352553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 455/875] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:49.359294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:49.469422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3290-ba8b-40b4-85b7-3805594e858f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:49.504991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:49.505657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:49.505936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:49.506210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:49.507081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=24ea97317d564485a0982fe7533561be) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:49.507393 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:49.508877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627982a8-0dc6-4b62-9d82-7f8434cf0a84 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:49.515717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 421/876] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:49 2022] GET /identity/v3/role_assignments?user.id=24ea97317d564485a0982fe7533561be&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:50.014878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515627-b587-4fba-ad00-6532ac64ecac None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.015414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515627-b587-4fba-ad00-6532ac64ecac None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.015414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515627-b587-4fba-ad00-6532ac64ecac None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.017041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 456/877] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:50.022558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.023036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.023239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.040933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:50.042018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:50.056916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:50.117516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 422/878] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:50.140718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515627-b587-4fba-ad00-6532ac64ecac None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.252140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515627-b587-4fba-ad00-6532ac64ecac None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.287945 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:50.288745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.289027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.289448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.290712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:50.292256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:50.304641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:50.306306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:50.307784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 457/879] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:50.312656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.417010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b500951-aaec-4571-b060-b5414db3d590 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.452012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:50.452682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.452961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.453231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.453943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:50.454250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:50.455642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93e053-a82f-4d63-a7a8-3ae967fd7e80 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:50.460767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 423/880] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:50.467810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.491170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:50.511136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689a8e-41b0-484e-a01c-dd0e7ed99790 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.511441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689a8e-41b0-484e-a01c-dd0e7ed99790 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.511692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689a8e-41b0-484e-a01c-dd0e7ed99790 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.513242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 424/881] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:50.519556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.520115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.520608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.541755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:50.543600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:50.558142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:50.586566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e8dbf-35df-4902-b1c9-1347e8d0e933 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.628469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:50.629512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.634732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 425/882] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:50.634881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.634881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.634881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:50.634881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:50.634881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:50.639567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 458/883] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:50.647804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.655857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.766207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00bb7a-e5da-4639-b50b-6a099fb21dde None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.768369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:50.800721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f84b-56dd-44e5-ad1e-57f896824e4d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.816492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:50.817662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.818514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.818923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.820118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] RBAC: Adding query filter params (interface=public, service_id=8ad65d8007c042a1965517b4a3bc5b1e, region_id=RegionOne) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:50.820592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:50.822673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:50.830950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 426/884] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/endpoints?service_id=8ad65d8007c042a1965517b4a3bc5b1e&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:50.835112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.845631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:50.846089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:50.846450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.846767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.847292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.859105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:50.867591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:50.869187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:28:50.870032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:50.874717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 459/885] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:50.876438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:50.955887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2579a84-f4a1-4a45-9d48-3fa618f491e4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.984708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8638-5727-467a-95ac-bfe357e27b61 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:50.989960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9755ae1-d89a-423c-9995-ec10e777a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:50.990638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755ae1-d89a-423c-9995-ec10e777a60b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:50.990954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755ae1-d89a-423c-9995-ec10e777a60b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:50.991236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755ae1-d89a-423c-9995-ec10e777a60b None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:50.991927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9755ae1-d89a-423c-9995-ec10e777a60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:50.993805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9755ae1-d89a-423c-9995-ec10e777a60b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:50.999475 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 427/886] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:28:51.000760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31077325-9942-43d8-a85c-83bbdea308ff None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.001060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31077325-9942-43d8-a85c-83bbdea308ff None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.001340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31077325-9942-43d8-a85c-83bbdea308ff None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.006883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 428/887] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:51.009572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.010074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.010811 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.029328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:51.031576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:51.032655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.033465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.033879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.034233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.035268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:51.035654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.037310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.048645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 460/888] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:28:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:51.055047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.067944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.109409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.115907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 429/889] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:51.146585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.216683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8cf06-b151-4553-8584-b6cb9dc69acc None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.258385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.259365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.259651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.259932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.272917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164e863-5ee5-42a2-b8cf-0940ff1339ee None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.274726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.275647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:51.296344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:51.297306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:51.298210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:51.298210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:51.298210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:51.298210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:51.298210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 461/890] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:51.310324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.312201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.313084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.313426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.313710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.314678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.317057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:51.333374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:51.334373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:51.335252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 430/891] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:51.341826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.388673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.430205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.440787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea525f8-7a45-4d4b-9667-544fc92a227d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.471737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6a77f-15d6-4a24-8615-d9eadf041200 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.479101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.479841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.480126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.480403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.481581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:51.481581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.482916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.500768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 462/892] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:51.501864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.517796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.518874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.519398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.519916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.520854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:51.521364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.522980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.529332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 431/893] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:51.535694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.617180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7a25-ecf0-4164-9178-9d1df3953774 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.637454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.656685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.657528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6641-e18b-4608-82cf-468a7fe70241 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.657757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.658181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.658568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.667712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.669162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-19e8e3d7-736a-42eb-bced-9f9e5609d886 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:51.686487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:51.687675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:51.688864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 463/894] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:51.689620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25391c30-80c3-488b-8354-aa55b8de8e40 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.689620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25391c30-80c3-488b-8354-aa55b8de8e40 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.689620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25391c30-80c3-488b-8354-aa55b8de8e40 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.690974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.691139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 464/895] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:51.696396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.696761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.697038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.703256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.703923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.704203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.704474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.705189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:51.705486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.706871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.712513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 432/896] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:51.713374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:51.714571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:51.718225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.794717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 465/897] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:51.794717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.834531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193701f-78f9-4dd7-8e1e-b07eed6172d2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.870641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.871263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.871541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.871813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.872656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:51.872959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.874376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.893021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 433/898] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:51.893834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:51.909179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba625db9-7d0d-42c8-a917-3b1bfabff453 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:51.920572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.946503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:51.949535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:51.950191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:51.950471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:51.950833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:51.951636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] RBAC: Adding query filter params (interface=public, service_id=518fa408b5cd4aa294ce3cf4dc3d6e93, region_id=RegionOne) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:51.951986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:51.953403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:51.958447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 466/899] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/endpoints?service_id=518fa408b5cd4aa294ce3cf4dc3d6e93&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:51.959289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.006259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bb92-274e-4e30-b688-06da1c1ec588 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.044056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.044987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.045270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.045570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.046306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.047694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:52.061435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:52.062651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:52.063744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 434/900] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:52.064549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.069536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b2687-b331-41dd-8b77-e340d71e60dd None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.108275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.109193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.109628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.110042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.153564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:52.177255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e0ab5-b078-40c2-9923-0035ab5ecfff None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.181100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.182592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.191942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:52.214503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.215213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.215501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.215780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.216640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.218012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.230943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 435/901] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:28:52.232309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.314385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 467/902] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:28:51 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:28:52.322784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.391117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1e77d-8967-4844-a225-b807ae463e69 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.404869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:52.435724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.436399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.436684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.436961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.437672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:52.437978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.439401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.446205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac4041-8c04-41f6-897b-462bb0e97209 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.447155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 436/903] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:52.452607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.491791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.493146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.493436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.493788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.501052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:52.507298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.509846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:52.531835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:52.532904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:52.534220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:52.534220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:52.534220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:52.534220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:52.534220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 468/904] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:52.540948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.572300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ac989-9f93-45a2-8b80-adda854ba392 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.616665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.618121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.618409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.618697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.620357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:52.620670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.622047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.628755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 437/905] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:52.657530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36935352-0379-42a1-85d6-c0ce70fdaf6b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.686417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:52.699958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.700642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.700926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.701203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.701998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:52.702309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.703825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.722547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 469/906] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:52.723516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:52.853087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe482-3522-40b2-9559-138d9f5378ee None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:52.861224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:52.889198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:52.890007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:52.890289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:52.890564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:52.897336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:52.898932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:52.914082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:52.915917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:52.916797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:52.919459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 438/907] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:52.925295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:53.032195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835929a1-4bd5-4d51-a0c4-35f3f447a252 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:53.067102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:53.067778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.068065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.068340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.069191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:53.069503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:53.071621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc835db-2404-428a-874b-bc894e26f965 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:53.084475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 470/908] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:53.091068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:53.199034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e6e1a-f449-42b2-9cb4-609b45117715 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:53.221394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbf10a-7b1b-4b98-974e-b4495a48897d None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.221748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbf10a-7b1b-4b98-974e-b4495a48897d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.221966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbf10a-7b1b-4b98-974e-b4495a48897d None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.223954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 471/909] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:53.231935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.232281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.232606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.240112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:53.240404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.240780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.241128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.242025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] RBAC: Adding query filter params (role.id=509708b5cd674858b1b72ae85c8440f1, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=9fe49b9d7762442aa250c9686d5bfce7) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:53.242981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:53.244428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:53.250730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 439/910] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:28:53 2022] GET /identity/v3/role_assignments?user.id=9fe49b9d7762442aa250c9686d5bfce7&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=509708b5cd674858b1b72ae85c8440f1 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:53.256036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:53.257555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:53.304356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:53.338707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 472/911] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:53.362276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:53.398641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:53.482252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad8f62-0683-496f-8679-25f82842dac5 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:53.517334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:53.518142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.518427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.518724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.519457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:53.520880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:53.533466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:53.534469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:53.535885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 440/912] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:53.540730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:53.644247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d768692-3da6-4c4a-a655-05100bdfe974 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:53.680697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:53.681461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.681743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.682015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.682752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:53.683066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:53.684433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:53.689446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 473/913] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:53.695025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:53.801156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:53.808412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd6c20-8414-413c-be9d-233ae60311f7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:53.843955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:53.844822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:53.845110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:53.845384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:53.846154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:53.846464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:53.847896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36d313-bf72-41c1-a00e-6fd19d15c9b7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:53.854957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 441/914] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Jul 21 10:28:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:53.860779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:53.907113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:53.969682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc11caf-1737-4427-a747-f42aef0ed203 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:54.005644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720d1f0-53ac-4f47-85f1-fe3d2ab892b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:54.006309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720d1f0-53ac-4f47-85f1-fe3d2ab892b0 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.006592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720d1f0-53ac-4f47-85f1-fe3d2ab892b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.006907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720d1f0-53ac-4f47-85f1-fe3d2ab892b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.007800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720d1f0-53ac-4f47-85f1-fe3d2ab892b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:54.009242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720d1f0-53ac-4f47-85f1-fe3d2ab892b0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:54.081910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 474/915] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:28:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:28:54.435175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b994a-2af5-4921-a921-71842e909945 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.435661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b994a-2af5-4921-a921-71842e909945 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.435661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b994a-2af5-4921-a921-71842e909945 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.437275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 442/916] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:54.442508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.442846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.443127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.460734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:54.462481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:54.541043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 475/917] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:54.564432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b994a-2af5-4921-a921-71842e909945 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:54.674129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b994a-2af5-4921-a921-71842e909945 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:54.709281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:54.710031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.710353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.710630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.711493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:54.712961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-f84f08e8-9778-46c4-88aa-025487bd29ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:54.725974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:54.728666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:54.730716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 443/918] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Jul 21 10:28:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:54.736277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:54.758216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:54.806924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887fd00-5836-4458-abe7-98f0a7bc0d89 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.807452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887fd00-5836-4458-abe7-98f0a7bc0d89 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.807915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887fd00-5836-4458-abe7-98f0a7bc0d89 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.810107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 444/919] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:54.814945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.815239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.815649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.832956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:54.834157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:54.871281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceaa97-d5ba-4cea-9f5d-d0548c93625c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:54.899656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:54.913828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:54.917317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:54.917440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 445/920] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:54.917522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:54.917522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:54.917522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:54.917522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:54.918532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:54.924416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 476/921] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:54.929830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:54.935998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:55.031274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:55.034864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932aa7-edad-4b87-86b7-6df69f5827b6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:55.043264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404188-cb77-4dc6-825c-ce35e92f2b40 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:55.072411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:55.073080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.073364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.073639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.074355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:55.074665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:55.076051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:55.088244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 446/922] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:55.090740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:55.093049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf315ed-c454-4eb9-8913-509d364c55f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:55.093854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf315ed-c454-4eb9-8913-509d364c55f3 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.094248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf315ed-c454-4eb9-8913-509d364c55f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.094831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf315ed-c454-4eb9-8913-509d364c55f3 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.095673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf315ed-c454-4eb9-8913-509d364c55f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:55.098086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf315ed-c454-4eb9-8913-509d364c55f3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:55.112733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:55.176037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 477/923] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:28:54 2022] POST /identity/v3/services => generated 241 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:28:55.207124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948af0d-73a6-4f3c-93ce-c1a4002540ad None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:55.254003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c496-d733-4dca-a8ee-e2c129d8732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:55.254994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c496-d733-4dca-a8ee-e2c129d8732f None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.255429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c496-d733-4dca-a8ee-e2c129d8732f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.255918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c496-d733-4dca-a8ee-e2c129d8732f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.256841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c496-d733-4dca-a8ee-e2c129d8732f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:55.258936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c496-d733-4dca-a8ee-e2c129d8732f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:55.373941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 447/924] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:28:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:28:55.449938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d4aa-e087-416c-898e-6b2de2d4e8cf None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.450390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d4aa-e087-416c-898e-6b2de2d4e8cf None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.450800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d4aa-e087-416c-898e-6b2de2d4e8cf None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.452656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 478/925] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:55.458780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.459304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.459607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.478533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:55.479781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:55.555579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:55.567041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 448/926] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:55.590491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d4aa-e087-416c-898e-6b2de2d4e8cf None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:55.704789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d4aa-e087-416c-898e-6b2de2d4e8cf None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:55.740333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:55.741157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.741440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.741715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.753058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:28:55.761533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:55.762461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:55.763476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 479/927] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Jul 21 10:28:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:55.778135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:55.890011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802de3c-e5ef-4a92-8a98-012c6a4b4b64 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:55.926742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:55.927708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:55.928146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:55.928577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:55.929578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:55.930123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:55.932297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:55.941590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 449/928] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:28:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:55.947474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:55.951588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:56.057365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13604-9cf6-4a17-87af-41fc98e3d612 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:56.092959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:56.094010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.094930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.095350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.107340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:56.108963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-f455af18-c37b-4f5f-927f-647214a25f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:56.126974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:56.128076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:56.129184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:56.129184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:56.129184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:56.129184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.131224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 480/929] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:56.142802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:56.200971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:56.248736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511c6f3-ec58-4d24-ab92-2a921390d63d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:56.285555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dbe6d-2600-4cc1-8d5a-b15341886c7a None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.285847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dbe6d-2600-4cc1-8d5a-b15341886c7a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.286107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dbe6d-2600-4cc1-8d5a-b15341886c7a None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.291186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 481/930] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:56.291290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:56.291290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.291290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.291290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.292067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:56.292574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:56.294154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:56.296048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.296401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.296681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.308458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 450/931] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:56.314803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:56.316371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:56.317732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:56.385434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:56.408733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 482/932] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:56.434420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:56.444128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9d2a1-5692-4b98-95c8-23f6a8a2b923 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:56.471438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:56.490305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:56.493149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.493149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.493509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.503817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:56.505383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:28:56.538096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:56.539396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:28:56.540445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:56.547123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 451/933] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:28:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:56.551650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:56.609581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735187-c27c-4465-b9fe-5643028b8a1c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:56.645973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:56.647115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.647442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.647818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.648535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:56.650123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:56.651510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING keystone.server.flask.common [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 10:28:56.692315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4424af-f9cc-4428-bd97-977badf08bb8 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:56.701267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.sql.core [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 10:28:56.701267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 10:28:56.701267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [parameters: {'id': 'abb9b6d6866344d784e7684e73ca6c42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 10:28:56.701267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80594) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id abb9b6d6866344d784e7684e73ca6c42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id abb9b6d6866344d784e7684e73ca6c42. Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:28:56.730016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result.read() Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 10:28:56.731034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application yield resource Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise self.value Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application session.commit() Jul 21 10:28:56.731988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.session.flush() Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application compat.raise_( Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 10:28:56.732913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 10:28:56.733827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result.read() Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:28:56.734636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [parameters: {'id': 'abb9b6d6866344d784e7684e73ca6c42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:56.736526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:56.738464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id abb9b6d6866344d784e7684e73ca6c42. Jul 21 10:28:56.740702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:56.743243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 483/934] 10.222.0.49 () {60 vars in 1140 bytes} [Thu Jul 21 10:28:56 2022] POST /identity/v3/projects => generated 262 bytes in 308 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:56.748237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:56.749702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:56.750461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:56.750914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:56.751266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:56.752254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:56.752635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:56.754144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:56.797383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 452/935] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Jul 21 10:28:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:56.798552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:56.839658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:56.854128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:56.959624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd7b97-df84-4ae3-a585-1a35df39de81 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:56.961493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e3e3-15c3-4ed8-abe4-725293032477 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.005545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.006445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.006905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.007509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.021724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.023315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.044242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.045393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.047692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.048160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:28:57.049284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:57.050156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:57.051105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:28:57.051105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:28:57.051105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:28:57.051105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:57.056317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 453/936] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:57.060384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.063484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.065422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:57.081241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:57.082209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:57.083120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:57.090615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 484/937] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:57.092171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.155644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:57.172832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4957f-9655-455a-a63e-bb52f9724d85 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.203468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0067fad-0fe9-4509-8a4a-fd26ab4ab55f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.205863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:57.212095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.212712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.213108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.213387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.214317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:57.214632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.216033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.234027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 454/938] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:57.234998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.245951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.247902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.247902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.247902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.249169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:57.249677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.251349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ad1c3-0bc9-46ce-8885-77182b678ffa None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.282657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 485/939] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:57.348820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147daab-30e2-4a64-9d4d-3aa71c03e3bb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.388079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.388908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.389194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.389474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.395703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c609-e35b-4c7c-b17e-5a5223b04782 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.395988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c609-e35b-4c7c-b17e-5a5223b04782 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.396273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c609-e35b-4c7c-b17e-5a5223b04782 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.397462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.397971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 486/940] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:28:57.399688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.404346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.404640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.404923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:28:57.416385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:57.417351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:57.419153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 455/941] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:57.423722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.427463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:57.429164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:57.433778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:57.518913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 487/942] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:28:57.536036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.540286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6f6c-e261-40c0-bd91-2820f2fee3b7 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.580561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.581237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.581524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.581803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.582606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:57.584815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.585203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.598977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 456/943] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:57.606333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.647306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:57.656359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3330d-c445-46a5-9608-80eeea1f1f2e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.678769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:57.692660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.693550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.693831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.694119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.694809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.696257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-93ff6687-6f3e-441f-9cd8-0739f517fb73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:57.709592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:57.710867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:28:57.711761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:57.717582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 488/944] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:28:57.718028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d553d-b4ce-439b-b5e3-ec63e1f64163 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.718942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33880b14-2a75-4f63-a5ea-e1c0ea4061ae None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.719238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33880b14-2a75-4f63-a5ea-e1c0ea4061ae None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.719520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33880b14-2a75-4f63-a5ea-e1c0ea4061ae None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.724959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 489/945] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:57.724959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33880b14-2a75-4f63-a5ea-e1c0ea4061ae None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.760019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf62b-bd68-48eb-83c7-884c0dbdae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.761336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf62b-bd68-48eb-83c7-884c0dbdae1d None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.761336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf62b-bd68-48eb-83c7-884c0dbdae1d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.761536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf62b-bd68-48eb-83c7-884c0dbdae1d None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/9fe49b9d7762442aa250c9686d5bfce7/roles/509708b5cd674858b1b72ae85c8440f1` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.763737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf62b-bd68-48eb-83c7-884c0dbdae1d None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=9fe49b9d7762442aa250c9686d5bfce7, role_id=509708b5cd674858b1b72ae85c8440f1)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.765178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf62b-bd68-48eb-83c7-884c0dbdae1d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.834225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33880b14-2a75-4f63-a5ea-e1c0ea4061ae None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:57.850392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 457/946] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:28:57 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/9fe49b9d7762442aa250c9686d5bfce7/roles/509708b5cd674858b1b72ae85c8440f1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:28:57.851730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.852705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.853014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.873657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:57.875547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:57.880790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:57.881834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:57.882267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:57.882729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:57.883772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:57.884436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:57.886208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:57.892844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 490/947] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:57.899590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:57.950670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:57.970804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 458/948] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:57.994430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:58.024794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7267-ce75-4964-92e6-ca24d03d712b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:58.068666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:58.070459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:58.071862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:58.072215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:58.072418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:58.073177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:58.073451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:58.074884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:58.082149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 491/949] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:58.088027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:58.124899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d3f40-8b63-47dd-bc5b-84f8c4fb71d2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:58.170972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:58.172137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:58.172490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:58.172840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:58.173606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:58.175353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:58.193121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:28:58.194248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:28:58.195433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:28:58.196734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 459/950] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:28:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:58.202424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:58.206021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:58.232744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555b7db-aebc-4ca2-93b4-c6e8f0f9502a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:58.279808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:58.281010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:58.281514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:58.282840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:58.283944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] RBAC: Adding query filter params (interface=public, service_id=34320c5489994aba93f7d23289fe7b2e, region_id=RegionOne) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:58.284468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:58.286214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:58.299114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 492/951] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:28:58 2022] GET /identity/v3/endpoints?service_id=34320c5489994aba93f7d23289fe7b2e&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:58.300169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:58.325061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bef9a-596d-40d1-9e75-d39031cc0761 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:58.353883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:58.369103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:58.369793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:58.370142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:58.370453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:58.371315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:58.371627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:58.373003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:58.382882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 460/952] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:28:58.384586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:58.439886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9afd9-f957-4520-9324-318bc748a414 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:58.478633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a274-874c-492b-8dc5-2e5e53448b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:58.479820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a274-874c-492b-8dc5-2e5e53448b45 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:58.480267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a274-874c-492b-8dc5-2e5e53448b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:58.480714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a274-874c-492b-8dc5-2e5e53448b45 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:58.481439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a274-874c-492b-8dc5-2e5e53448b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:58.482834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a274-874c-492b-8dc5-2e5e53448b45 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:58.489559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 493/953] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:28:58 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:28:58.498671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f226-609b-4484-90c6-f92010aeac09 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:58.539409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:58.540679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:58.541231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:58.541436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:58.542173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:28:58.542483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:58.543931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341acbb-5d84-4907-aeb2-eabcc6b42e33 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:58.550186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 461/954] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:28:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:28:59.521732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e147-feb4-40b7-b934-3fab956843fb None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:59.522300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e147-feb4-40b7-b934-3fab956843fb None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:59.522300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e147-feb4-40b7-b934-3fab956843fb None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:59.524692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 494/955] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:28:59.529920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:59.530203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:59.530473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:59.547975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:28:59.549153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:28:59.598516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:59.624169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 462/956] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:28:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:28:59.651492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10e147-feb4-40b7-b934-3fab956843fb None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:59.670338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:28:59.769258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10e147-feb4-40b7-b934-3fab956843fb None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:28:59.804677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:28:59.805922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:28:59.806287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:28:59.806578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:28:59.807370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:28:59.808821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:28:59.849613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.sql.core [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 10:28:59.849613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 10:28:59.849613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [parameters: {'user_id': 'f42c7b6685764b74a06f81ad132274df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 10:28:59.849613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80594) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result.read() Jul 21 10:28:59.858186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:28:59.859420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application yield resource Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application next(self.gen) Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise self.value Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application session.commit() Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 10:28:59.860844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.session.flush() Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application compat.raise_( Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 10:28:59.861747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 10:28:59.862624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application conn.query(q) Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application result.read() Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 10:28:59.863525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f42c7b6685764b74a06f81ad132274df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:28:59.864387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 10:28:59.865211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:28:59.866144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 495/957] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Jul 21 10:28:59 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:28:59.866572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:28:59.971596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcaf0e-c538-4f4b-b45a-c7ccf27ef437 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.008149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.009024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.009308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.009588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.017232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:00.018703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-bf7ad8ad-8cf1-4813-8298-45e13b532c9e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:29:00.034351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:00.036593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:00.038859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 463/958] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:28:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:00.047889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.048124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5e8b2-554f-45ac-a399-6edd2ba38c1c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.048407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5e8b2-554f-45ac-a399-6edd2ba38c1c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.048605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5e8b2-554f-45ac-a399-6edd2ba38c1c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.050209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 464/959] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:00.056328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.056671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.056957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.079404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:00.080893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:00.115829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:00.132841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:00.158971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83faa-d64e-4c48-8ca9-811e33e0ca48 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.160149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 465/960] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:00.186227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.198578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.199738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.200208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.200670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.201729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:00.202331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:00.204357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:00.249481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 496/961] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Jul 21 10:29:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:00.309310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8a07-bb3a-47fe-bfd8-20af7da02903 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.349148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.350236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.350519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.350821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.362840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:00.371523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:00.372539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:00.373383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 466/962] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Jul 21 10:29:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:00.380918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.495848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eae72-a4f7-4e20-835e-9efb197fe071 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.527378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:00.533685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.534364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.534643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.534943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.535695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:00.536064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:00.537616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e08ddb-5a1d-409c-9d4b-af9fbd661ed3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:00.547077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 497/963] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:29:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:00.552704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.584021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:00.658030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be23a-c626-4d31-bb69-03da4c22b58d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.667568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111244dd-b57c-4943-91dd-d9e8b8c9ff7e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.667864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111244dd-b57c-4943-91dd-d9e8b8c9ff7e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.668167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111244dd-b57c-4943-91dd-d9e8b8c9ff7e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.669907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 498/964] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:00.674721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaac8a-331e-4e89-a8d0-1501ab41ed43 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.675016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaac8a-331e-4e89-a8d0-1501ab41ed43 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.675298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaac8a-331e-4e89-a8d0-1501ab41ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.692610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6bbaac8a-331e-4e89-a8d0-1501ab41ed43 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:00.694135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6bbaac8a-331e-4e89-a8d0-1501ab41ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:00.695473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.696584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.697674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.697979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.711061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:00.712562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-957acbd6-4d77-490e-bfb5-1c670e38b008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:00.731144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:00.732292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:00.733275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:00.733275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:00.733275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:00.733275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:00.733275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 467/965] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:00.733865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a849-dc3c-44a2-b8db-12eb5070e08e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.734156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a849-dc3c-44a2-b8db-12eb5070e08e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.734428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a849-dc3c-44a2-b8db-12eb5070e08e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.735730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 468/966] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:00.737736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a849-dc3c-44a2-b8db-12eb5070e08e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.768183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 499/967] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:00.769467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.769759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.770037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.790956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:00.792167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:00.828198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:00.847856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a849-dc3c-44a2-b8db-12eb5070e08e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.860520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 500/968] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:00.861357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.888564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.889250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.889528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.889798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.890521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:00.890856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:00.892207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:00.903797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 469/969] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:00.904560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:00.917433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:00.961099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b1dc-0cfc-4067-a7cb-2c36c9925838 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:00.995302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:00.996115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:00.996402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:00.996680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:00.997340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:00.998721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.006040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27e38a-8c66-4f15-bf5c-90eda0d451b6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:01.010722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:01.011760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:01.012615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 501/970] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:29:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:01.013462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.041992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.042657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.042965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.043241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.043955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.045307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.113138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f1ef7-66fd-464d-9acc-bf1435bfc376 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.129773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:01.130861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:01.136771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 470/971] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:29:00 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:01.137568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.156333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.157209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.157522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.157781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.166780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.168309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:29:01.184157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:01.185411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:01.186583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 502/972] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:01.191380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.257411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba8c3a-e131-48d9-b677-008a5d20c06a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.297573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.298725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.298725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.298977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.299578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:01.299884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.301514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.306399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e35ee-30be-4116-9708-785d006396fb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.308398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 471/973] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:01.313487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.352281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.353354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.353654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.354005 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.354906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:01.355297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.356807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.375798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 503/974] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:01.381234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.381640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:01.416997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:01.423223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a83df-c923-49ac-9cc3-bd081dbcee54 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.459392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.460115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.460401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.460679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.462015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:01.462361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.463851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.469957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 472/975] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:01.475792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.498575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e847f-b91a-456b-96ed-922de364ffae None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.542434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.543844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.544138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.544420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.580407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c21c-7074-478a-90f5-f1a5302ba6b1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.609041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:01.617389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.624758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.624758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.624758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.624758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.624758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.625531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.626633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.658098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:01.696883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 473/976] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:29:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:29:01.740963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 504/977] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:29:01.742389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:01.874400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756278-28e9-48fc-a7c2-c1d70671230a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:01.911129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:01.912254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:01.912756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:01.913251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:01.925796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:01.927603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:01.946868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:01.947781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:01.948664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:01.948664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:01.948664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:01.948664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:01.950912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 474/978] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:01.956149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:02.061310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a6aef-0780-4220-9bc1-86301a0ec6c8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:02.092148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:02.097740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:02.098402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:02.098680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:02.098975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:02.099959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:02.100263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:02.101663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:02.117480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 505/979] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:02.119214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:02.154253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:02.227949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d520f-4cdb-408c-aae8-6d357bb558cb None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:02.264204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:02.265008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:02.265293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:02.268318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:02.272868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:02.274563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:29:02.288524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:02.290426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:02.291805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:02.295043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 475/980] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:02.296378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:02.407577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97195-c606-444f-a72d-43ca40eec1e0 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:02.442002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:02.442671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:02.442981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:02.443255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:02.444047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:02.444355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:02.445828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3dfab-f556-4b20-9d6d-1bc29c3be088 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:02.462463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 506/981] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:02.464769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:02.560201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:02.569250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e62be-86d9-4b40-bc4c-ef207fbf81c6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:02.603563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:02.604251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:02.604523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:02.604801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:02.605670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] RBAC: Adding query filter params (role.id=509708b5cd674858b1b72ae85c8440f1, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=9fe49b9d7762442aa250c9686d5bfce7) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:02.606006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:02.607524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70af4ff-5bec-496b-bcbe-ad411603c5ad None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:02.622788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 476/982] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:02 2022] GET /identity/v3/role_assignments?user.id=9fe49b9d7762442aa250c9686d5bfce7&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=509708b5cd674858b1b72ae85c8440f1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:03.236123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca2f58-c7db-489b-ab18-6561db453de2 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.236674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca2f58-c7db-489b-ab18-6561db453de2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.236674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca2f58-c7db-489b-ab18-6561db453de2 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.238239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 507/983] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:03.243880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.244174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.244453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.261995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:03.266782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:03.332198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 477/984] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:03.355430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca2f58-c7db-489b-ab18-6561db453de2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:03.410523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:03.460249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca2f58-c7db-489b-ab18-6561db453de2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:03.495189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:03.495923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.496208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.496486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.497140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:03.498507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:03.510433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:03.511613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:29:03.512539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:03.514089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 508/985] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:29:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:03.517589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:03.605357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:03.622034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782485e-54e5-473a-a920-aa2d7b7f131b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:03.657009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:03.657680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.657968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.658243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.658992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:03.659303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:03.660664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9127-aeba-497f-b6e7-e0a32aed3602 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:03.670807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 478/986] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:29:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:03.672080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:03.761459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37278e7-58cd-49f9-a7ba-8bf9cfe84cb8 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.761651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37278e7-58cd-49f9-a7ba-8bf9cfe84cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.761912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37278e7-58cd-49f9-a7ba-8bf9cfe84cb8 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.763314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 479/987] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:03.768422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.768711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.768986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.789521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:03.791319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:03.791802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb74c-8ef5-4056-ba11-9516233b072a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:03.812201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:03.831650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:03.832353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.832593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.832865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.833571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:03.833907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:03.835323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:03.846510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 509/988] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:29:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:03.847513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:03.869655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 480/989] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:03.891505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:03.957895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe258d7-a6f6-4bc5-a486-4b1dadab5d07 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:03.972804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:03.992656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f9fa-81a3-4019-bc07-ad6beb8f1737 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:03.994986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:03.995645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:03.995927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:03.996199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:03.996984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] RBAC: Adding query filter params (interface=public, service_id=cd3402f5e46f41b986eb6d0fba826532, region_id=RegionOne) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:03.997303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:03.998676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.006130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 510/990] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:29:03 2022] GET /identity/v3/endpoints?service_id=cd3402f5e46f41b986eb6d0fba826532&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:04.011845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:04.033584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:04.034426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.034793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.035086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.035913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:04.037149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:04.050080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:04.051320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:04.052176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 481/991] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:29:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:04.057247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:04.065420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:04.120130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88126-aa8f-46d1-8d73-c4116357c515 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:04.158281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:04.158985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.159273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.159550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.160239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:04.161617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.166484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170508-f66c-4e34-b07d-1a43bf230f50 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:04.168517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 511/992] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:29:04 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:29:04.205033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:04.205699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.205979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.206255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.207011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:04.207319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:04.208712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.220440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 482/993] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:29:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:04.221321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:04.333247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abc796-c454-4828-87c4-b93a8cc00229 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:04.343182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:04.373924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:04.374597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.374932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.375204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.375913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:04.376218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:04.377567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.386715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 512/994] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:29:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:04.389681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:04.401440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:04.496442 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130292bb-28c8-45df-b07d-077c8f879a9e None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:04.531364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:04.532019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.532299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.532573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.533376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] RBAC: Adding query filter params (interface=admin, service_id=34320c5489994aba93f7d23289fe7b2e, region_id=RegionOne) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:04.533685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:04.535068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf974bda-c926-4eec-b2e0-7d62850f9121 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.541403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 483/995] 10.222.0.49 () {56 vars in 1249 bytes} [Thu Jul 21 10:29:04 2022] GET /identity/v3/endpoints?service_id=34320c5489994aba93f7d23289fe7b2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:04.546949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:04.651878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367575f4-45ec-47c0-9466-6b2f6aecf87e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:04.686158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8ed9-01ef-4bc8-9aca-3e4976898157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:04.686857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8ed9-01ef-4bc8-9aca-3e4976898157 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.687143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8ed9-01ef-4bc8-9aca-3e4976898157 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.687418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8ed9-01ef-4bc8-9aca-3e4976898157 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.688114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e8ed9-01ef-4bc8-9aca-3e4976898157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:04.689477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e8ed9-01ef-4bc8-9aca-3e4976898157 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:04.696972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 513/996] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:29:04 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:29:04.754451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2b5f-44de-4697-8124-149f9b9406c2 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.755025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2b5f-44de-4697-8124-149f9b9406c2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.755025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2b5f-44de-4697-8124-149f9b9406c2 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.756599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 484/997] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:04.762921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:04.763225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:04.763501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:04.787025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:04.788269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:04.822452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:04.864718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 514/998] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:04.887472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2b5f-44de-4697-8124-149f9b9406c2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:04.959890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:04.991943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2b5f-44de-4697-8124-149f9b9406c2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:05.027068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:05.027867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:05.028147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:05.028421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] PATH_INFO: `/v3/services/image` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:05.029069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:05.030423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:05.042462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:05.043650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:05.044498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:05.046775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 485/999] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Jul 21 10:29:04 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:05.049904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:05.149226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc87b1-2cbe-4e2a-868d-71e9b8190149 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:05.185203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:05.185877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:05.186161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:05.186434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:05.187175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] RBAC: Adding query filter params (name=image) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:05.187485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:05.188848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f165404-c198-4169-bc73-055f8b31e065 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:05.198789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 515/1000] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:05.199755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:05.302734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616a29-695a-4309-b26e-7dc74a20722f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:05.339227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:05.339905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:05.340189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:05.340466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:05.341181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] RBAC: Adding query filter params (type=image) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:05.341488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:05.342886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3c7d-0cfa-4a87-910e-779eea520c9f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:05.344995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:05.354948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 486/1001] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:06.268542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5e807-21a9-406d-a32c-86803db0cdd5 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.269086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5e807-21a9-406d-a32c-86803db0cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.269086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5e807-21a9-406d-a32c-86803db0cdd5 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.270587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 516/1002] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:06.275926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.276308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.276471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.293259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:06.294471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:06.362549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 487/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:06.386146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5e807-21a9-406d-a32c-86803db0cdd5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:06.417854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:06.494854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5e807-21a9-406d-a32c-86803db0cdd5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:06.529073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:06.529780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.530059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.530331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.531012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:06.532375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:06.544883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:06.545882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 10:29:06.546754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:06.551011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 517/1004] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:29:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:06.552096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:06.653251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132848c9-df30-4c52-bc2a-e5373a827b87 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:06.682937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:06.689059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:06.689722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.690002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.690276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.691020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:06.691322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:06.696860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72864fe0-0ec9-4b04-92fb-6ae886a25c91 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:06.698057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 488/1005] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:29:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:06.703507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:06.742622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724b6b-73ce-4498-9733-dfef556373fd None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.743530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724b6b-73ce-4498-9733-dfef556373fd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.743812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724b6b-73ce-4498-9733-dfef556373fd None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.745519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 489/1006] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:06.750462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.750778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.751065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.770668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:06.774672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:06.810239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:06.817017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c748c-52ab-42e7-9c86-a47304f5e5f4 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:06.847178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 490/1007] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:06.854361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:06.855104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:06.855388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:06.855661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:06.856420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:06.856730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:06.858093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:06.867876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 518/1008] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Jul 21 10:29:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:06.869019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:06.871799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:06.978613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df90b8-bf2f-40a3-9c28-26ff4cfed111 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:06.984845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d3b3-fadc-4b31-9b7d-6e2287e09a81 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:07.003878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:07.016054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:07.016721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.017206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.017371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.018251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:07.019640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:07.021722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:07.022788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.023222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.023661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.025012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:07.026376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:07.039010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:07.040642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:07.041513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 519/1009] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Jul 21 10:29:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:07.046571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:07.071935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:07.106720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 491/1010] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:29:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:07.154326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371c7dd-e38d-4717-a9fc-2a97e30bd05e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:07.199234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:07.199916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.200201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.200478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.201199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:07.201508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:07.202925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:07.208601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 520/1011] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:29:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:07.215493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:07.368603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72bf5c-5100-4810-af16-009dad1b56f4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:07.404799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:07.405473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.405757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.406028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.406772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:07.407082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:07.408436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8530201-5b85-4c3f-84a3-00b3ee3ab7ef None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:07.413663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 492/1012] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Jul 21 10:29:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:07.419997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:07.426730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ccb5c-fc42-4fe6-a577-6654d0762a84 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.427224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ccb5c-fc42-4fe6-a577-6654d0762a84 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.427505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ccb5c-fc42-4fe6-a577-6654d0762a84 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.429014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 493/1013] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:07.434151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.434443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.434755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.451878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:07.453065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:07.496548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:07.509203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:07.524809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 494/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:07 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:07.531476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c199-6652-4833-a3ab-3c6ff3f1028d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:07.547939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:07.569528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abab7e-9b5a-4e1c-aa45-d7cc93f4d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:07.570191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abab7e-9b5a-4e1c-aa45-d7cc93f4d3c1 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.570477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abab7e-9b5a-4e1c-aa45-d7cc93f4d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.570850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abab7e-9b5a-4e1c-aa45-d7cc93f4d3c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.571669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abab7e-9b5a-4e1c-aa45-d7cc93f4d3c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:07.573065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abab7e-9b5a-4e1c-aa45-d7cc93f4d3c1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:07.630810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 521/1015] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:29:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:07.667072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9eb3-c256-4c0e-824f-72ce695f3335 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:07.715060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1a80-d28c-4f3a-a763-1b183a0f34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:07.715741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1a80-d28c-4f3a-a763-1b183a0f34fa None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:07.716023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1a80-d28c-4f3a-a763-1b183a0f34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:07.716295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1a80-d28c-4f3a-a763-1b183a0f34fa None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:07.717038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b1a80-d28c-4f3a-a763-1b183a0f34fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:07.718425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b1a80-d28c-4f3a-a763-1b183a0f34fa None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:07.819168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 495/1016] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:29:07 2022] POST /identity/v3/services => generated 242 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:29:09.283893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc106-f29c-4be3-a49b-65911d474876 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.284421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc106-f29c-4be3-a49b-65911d474876 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.284501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc106-f29c-4be3-a49b-65911d474876 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.285872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 522/1017] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:09.291808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af263f8-d418-4265-a338-e23e10081020 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.292247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af263f8-d418-4265-a338-e23e10081020 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.292396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af263f8-d418-4265-a338-e23e10081020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.309194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-6af263f8-d418-4265-a338-e23e10081020 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:09.310417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6af263f8-d418-4265-a338-e23e10081020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:09.334294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:09.386739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 496/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:09.409237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fc106-f29c-4be3-a49b-65911d474876 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:09.515790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fc106-f29c-4be3-a49b-65911d474876 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:09.550426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c6d47-2e26-42fc-ab51-465c6ba334c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:09.551201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6d47-2e26-42fc-ab51-465c6ba334c0 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.551488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6d47-2e26-42fc-ab51-465c6ba334c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.551767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6d47-2e26-42fc-ab51-465c6ba334c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.563169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c6d47-2e26-42fc-ab51-465c6ba334c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-528c6d47-2e26-42fc-ab51-465c6ba334c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:09.571325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:09.572275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:09.573123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:09.575122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 523/1019] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Jul 21 10:29:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:09.578420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af263f8-d418-4265-a338-e23e10081020 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:09.679295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af263f8-d418-4265-a338-e23e10081020 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:09.685199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206c26-65c8-4b00-be53-a4d72fd57e2f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.685483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206c26-65c8-4b00-be53-a4d72fd57e2f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.685757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206c26-65c8-4b00-be53-a4d72fd57e2f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.687311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 524/1020] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:09.692040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.692325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.692599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.698059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:09.710757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:09.712002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:09.716184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:09.717047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.717504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.717974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.718942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:09.719393 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:09.720899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:09.730437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 497/1021] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:29:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:09.735995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:09.755629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:09.795043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 525/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:09.820250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:09.852527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c039-bf8f-4928-8d60-fb3f0e72b5ef None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:09.887861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:09.888647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.888924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.889195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.899681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:09.901121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-8beb0dd9-3d45-4d96-954a-af047f05d1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:09.918147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:09.919096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:09.920001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:09.920001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:09.920001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:09.920001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:09.920001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 498/1023] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:09.920870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc0af-e537-41f7-a7e7-a0c3e1f4fdff None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.921156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc0af-e537-41f7-a7e7-a0c3e1f4fdff None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.921434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc0af-e537-41f7-a7e7-a0c3e1f4fdff None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.922702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 499/1024] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:09.925093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cc0af-e537-41f7-a7e7-a0c3e1f4fdff None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:09.927391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f00a-4b0e-4475-b613-16335b9000df None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:09.959726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:09.965498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea8ca-b4f4-41f8-a9b5-374c4ab3cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:09.966704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea8ca-b4f4-41f8-a9b5-374c4ab3cadc None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.969882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea8ca-b4f4-41f8-a9b5-374c4ab3cadc None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.969882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea8ca-b4f4-41f8-a9b5-374c4ab3cadc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.969882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea8ca-b4f4-41f8-a9b5-374c4ab3cadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:09.970286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea8ca-b4f4-41f8-a9b5-374c4ab3cadc None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:09.971966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 526/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:09.973105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:09.973388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:09.973657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:09.991180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:09.992372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:09.996238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.027955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cc0af-e537-41f7-a7e7-a0c3e1f4fdff None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.059085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 527/1026] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:10.059891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.060956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.061619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.061902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.062175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.062938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:10.063246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.064598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.081287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 500/1027] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:10.081818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.163239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378ff58-52a3-4aa2-af1a-87e9a0315ee2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.179932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06411411-ea38-45cd-94f5-5b73331ad322 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.190498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.197061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.204657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.204657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.204657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.204657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.204657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.209133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.215797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.216583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.216896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.217170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] PATH_INFO: `/v3/services/image` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.217827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.219231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:10.231320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:10.233721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:10.234566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 501/1028] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:10.235451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.283229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 528/1029] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:29:10 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:10.284054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.345112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53fd0b-cc34-477e-b832-d2da1c3fa2ba None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.385513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.386334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.386668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.386926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.395945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.397422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:29:10.414029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:10.415830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:10.416806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 502/1030] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:10.421980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.425632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f462e-cb67-450b-8c35-c6fdd3775ca5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.469855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.470534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.470846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.471126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.471851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] RBAC: Adding query filter params (name=image) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:10.472162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.473537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.479774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 529/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:10.485464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.495243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.543139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d48b9-14f3-4df6-b8e0-70f51c70cdd5 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.546477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.578388 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.579105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.579397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.579676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.580533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:10.580843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.582279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.601967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 503/1032] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:10.608279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.612594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837fc1e-eedc-48ca-a886-dbfac699e790 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.651934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.652610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.653271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.653557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.654596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:10.654939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.656474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.666243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 530/1033] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:10.667360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.718035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e3e6-4574-49c0-b7a3-be7337d01eec None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.732881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.755822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.756795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.757359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.757638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.787252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f9670-94a9-477c-9b6a-0a90a07759b9 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.799637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.824652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.825320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.825604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.825885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.826861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] RBAC: Adding query filter params (interface=public, service_id=cd12ff57cb0e419a86c0ecd4d4f1ed11, region_id=RegionOne) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:10.827286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.828687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.834341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.835823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.840417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 531/1034] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/endpoints?service_id=cd12ff57cb0e419a86c0ecd4d4f1ed11&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:10.841295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.939101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 504/1035] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:29:10.944688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:10.952696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b78ba-d132-47f0-913c-d682a58f3f73 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:10.960048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:10.987549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:10.988217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:10.988504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:10.988783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:10.989471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:10.990878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:10.997964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 532/1036] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:29:11.058850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e633ca-ed60-4010-b20d-ac3d8b3304d4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:11.096937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:11.097761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:11.098045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:11.098321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:11.110844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:11.112391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:11.132154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:11.133142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:11.134047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:11.134047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:11.134047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:11.134047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:11.134047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 505/1037] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:11.139349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:11.185566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:11.246873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b241dbd-b463-46a9-bfe2-2dd7fdd515d5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:11.281336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:11.282062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:11.282347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:11.282621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:11.283380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:11.283757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:11.285097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:11.298966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 533/1038] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:11.304634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:11.370563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:11.409726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165ad4-4b6c-4c54-afed-f0640bc789f9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:11.446986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:11.447830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:11.448112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:11.448381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:11.455514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:11.456953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:29:11.471448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:11.472373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:11.475766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 506/1039] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:11.479423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:11.577785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:11.582043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12956-659b-454f-b4b3-3a1b2fe33df5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:11.617016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:11.617707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:11.618120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:11.618525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:11.619352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:11.619667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:11.621139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a797c5-e850-4631-a0b6-5b72ef974c4c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:11.638114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 534/1040] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:11.639709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:11.744750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a144c14-8948-4b7c-a957-60ebee5ee178 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:11.767331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:11.784869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:11.785537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:11.785823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:11.786105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:11.786994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] RBAC: Adding query filter params (role.id=509708b5cd674858b1b72ae85c8440f1, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0be525488dbf496cb0440dc4b046df85) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:11.787317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:11.788892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4729a77-487f-474d-98d0-208027cbeefa None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:11.802745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 507/1041] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:11 2022] GET /identity/v3/role_assignments?user.id=0be525488dbf496cb0440dc4b046df85&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=509708b5cd674858b1b72ae85c8440f1 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:12.374551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8932-0116-425d-b8d6-dad28f970899 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:12.375138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8932-0116-425d-b8d6-dad28f970899 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:12.375138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8932-0116-425d-b8d6-dad28f970899 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:12.376561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 535/1042] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:12.381665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:12.382066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:12.382232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:12.399978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:12.401168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:12.468149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 508/1043] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:12.494160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8932-0116-425d-b8d6-dad28f970899 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:12.593723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8932-0116-425d-b8d6-dad28f970899 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:12.627864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c9466-99f1-41eb-914a-07bc8e1ddc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:12.628584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c9466-99f1-41eb-914a-07bc8e1ddc14 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:12.628870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c9466-99f1-41eb-914a-07bc8e1ddc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:12.629147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c9466-99f1-41eb-914a-07bc8e1ddc14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:12.630320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c9466-99f1-41eb-914a-07bc8e1ddc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:12.631777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c9466-99f1-41eb-914a-07bc8e1ddc14 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:12.638063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 536/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:12.639756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:12.742360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009804-69dd-4e38-986f-61df1c90db01 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:12.760625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:12.782867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf023-c945-4834-b7a7-d1bd599b4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:12.783501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf023-c945-4834-b7a7-d1bd599b4695 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:12.783789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf023-c945-4834-b7a7-d1bd599b4695 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:12.797711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf023-c945-4834-b7a7-d1bd599b4695 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:12.797711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbf023-c945-4834-b7a7-d1bd599b4695 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:12.797711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbf023-c945-4834-b7a7-d1bd599b4695 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:12.885279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 509/1045] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:29:12 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:29:13.072270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757e2f-ed21-4226-b35e-46670e49b614 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.072614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757e2f-ed21-4226-b35e-46670e49b614 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.072839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757e2f-ed21-4226-b35e-46670e49b614 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.074370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 537/1046] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:13.079503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.079801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.080084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.097880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:13.099153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:13.170502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 510/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:13.193683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757e2f-ed21-4226-b35e-46670e49b614 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:13.224035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:13.302205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757e2f-ed21-4226-b35e-46670e49b614 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:13.337681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:13.338496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.338811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.339090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.339744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:13.341106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:13.353055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:13.354055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:13.354940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 538/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Jul 21 10:29:13 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:13.362178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:13.466767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570e21-d1d9-411f-8d7a-edfb4eddd6b9 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:13.469014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:13.503069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:13.504136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.504418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.504691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.505487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] RBAC: Adding query filter params (name=image) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:13.505797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:13.507192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:13.514852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 511/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:13.518604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:13.617147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:13.627465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80ec48-f9ca-4258-ac69-082f555821b9 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:13.662377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:13.663085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.663371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.663647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.664360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] RBAC: Adding query filter params (type=image) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:13.664792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:13.666199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933690-8f74-4d59-87cf-2a597649097a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:13.675771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 539/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:13.676927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:13.785186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32e20-eb0c-44d6-b86f-7e2e1d44550d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:13.822168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:13.822498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.822833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.823113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.823907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:13.825277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:13.857678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ce40d-7438-47c4-a8a0-33dd48ac2dc9 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.857962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ce40d-7438-47c4-a8a0-33dd48ac2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.858234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ce40d-7438-47c4-a8a0-33dd48ac2dc9 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.859631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 540/1051] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:13.864406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:13.864687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:13.864959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:13.882564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:13.884721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:13.905552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 512/1052] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:29:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:13.978504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 541/1053] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:14.001413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:14.031985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:14.119702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96197731-c527-4d3d-9c34-4f689eb8e207 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:14.154241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:14.155142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:14.155430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:14.155707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:14.166437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:14.174578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:14.175682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:14.176550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 513/1054] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Jul 21 10:29:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:14.182542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:14.267554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:14.287572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1561e0d-a768-43d6-9910-b3742c0ea473 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:14.323518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:14.324557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:14.325051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:14.325546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:14.326520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:14.327085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:14.328666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:14.342768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 542/1055] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:29:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:14.344442 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:14.435722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:14.451436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9b0e8-6706-433d-8eb9-a4c5ebb742d9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:14.486980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:14.487781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:14.488067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:14.488347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:14.498828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:14.500276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:14.518044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:14.519194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:14.520099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:14.520099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:14.520099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:14.520099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:14.520099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 514/1056] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:14.526931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:14.629682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aeba9-cb75-4119-8768-830a8df23ed1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:14.665516 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:14.666185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:14.666466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:14.666763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:14.667490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:14.667796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:14.669157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:14.687304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 543/1057] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:14.688985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:14.801110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b86cd-d60f-4883-bf6b-6a6f0942b1ca None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:14.835249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:14.836047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:14.836427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:14.837432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:14.840195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:14.845579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:14.847059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-84e8301d-3117-4f89-9d02-54355fe779ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:29:14.861959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:14.863193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:29:14.864476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:14.867040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 515/1058] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:29:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:14.869437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:14.872336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:14.975489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988efd2-d23f-4ee5-a3ae-461c9aade7d8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:14.992217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d558-8a16-4151-8d3c-9427318a0cd0 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:14.992502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d558-8a16-4151-8d3c-9427318a0cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:14.993591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d558-8a16-4151-8d3c-9427318a0cd0 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:14.995265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 516/1059] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:15.000015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.000299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.000572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.011119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.011798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.012088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.012367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.013228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:15.013541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.014994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.019262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:15.020440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:15.033034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 544/1060] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:29:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:15.038363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.094965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 517/1061] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:15.107396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.117686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.155065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552314-51e3-4e25-a8b4-e17cd22a1b75 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.191373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.192164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.192441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.192710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.203487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.204920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.222193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a16b85-012c-4487-a001-85b9574a33cb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:15.225296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:15.232310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:15.233216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:15.233216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:15.233216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:15.233216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:15.233216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 545/1062] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:15.233216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.253526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.264615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.265672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.265953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.266227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.278413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:15.288587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:15.289545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:15.290801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:15.294901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 518/1063] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:15.299627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.342010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c11b-b750-446f-8f10-8921e79ed28b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.357367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.378962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.379627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.379910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.380187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.380916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:15.381221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.382583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.400031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 546/1064] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:15.400845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.407916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd279434-ea40-44ab-83c7-d53345e948db None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.444265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.444934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.445217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.445496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.446283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:15.446591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.447996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.461168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 519/1065] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:15.462777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.506310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049fc06-a7b3-4af4-a21b-33b9321f47ab None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.516977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.539224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.540586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.540957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.541327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.548614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.550085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:29:15.565203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:15.566141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:15.567085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 547/1066] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:15.573598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.575503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28c2a9-ccd8-47db-aa93-fb7e06a35de3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.606716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.621134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.622522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.622522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.622522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] PATH_INFO: `/v3/users/47761f1521e842c0ac3b5d4ec5571cf2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.636495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] RBAC: Authorizing `identity:get_user(user_id=47761f1521e842c0ac3b5d4ec5571cf2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.637956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.640100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 520/1067] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/users/47761f1521e842c0ac3b5d4ec5571cf2 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:15.645447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.686971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27d7a-713d-4c58-af86-833452a577c6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.722833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.723495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.723784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.724055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.725101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:15.725409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.726857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.738716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 548/1068] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:15.745064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:15.765209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa083ec6-2b58-4192-b035-25154b0a28c3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.773146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.800849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67090365-adc7-4e0e-b6a8-67c9ff6ab989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.801504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67090365-adc7-4e0e-b6a8-67c9ff6ab989 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.801786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67090365-adc7-4e0e-b6a8-67c9ff6ab989 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.802060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67090365-adc7-4e0e-b6a8-67c9ff6ab989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.848672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:15.859126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8d245-0f75-406e-9def-aec71fa90891 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:15.873782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67090365-adc7-4e0e-b6a8-67c9ff6ab989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.875268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67090365-adc7-4e0e-b6a8-67c9ff6ab989 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.895949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478845-1267-4950-b946-70d8c145256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:15.896843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478845-1267-4950-b946-70d8c145256d None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:15.897126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478845-1267-4950-b946-70d8c145256d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:15.897400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478845-1267-4950-b946-70d8c145256d None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0be525488dbf496cb0440dc4b046df85/roles/509708b5cd674858b1b72ae85c8440f1` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:15.900055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64478845-1267-4950-b946-70d8c145256d None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=0be525488dbf496cb0440dc4b046df85, role_id=509708b5cd674858b1b72ae85c8440f1)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:15.901496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64478845-1267-4950-b946-70d8c145256d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:15.981343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 549/1069] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:29:15 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0be525488dbf496cb0440dc4b046df85/roles/509708b5cd674858b1b72ae85c8440f1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:29:15.981921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 521/1070] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:29:15.982828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478845-1267-4950-b946-70d8c145256d None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:16.003269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3141f-dee6-4538-8b98-d84a1b7ea0e2 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.003926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3141f-dee6-4538-8b98-d84a1b7ea0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.004410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3141f-dee6-4538-8b98-d84a1b7ea0e2 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.006759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 522/1071] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:16.013273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.013563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.013851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.026191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:16.033390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:16.034847 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:16.108920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478845-1267-4950-b946-70d8c145256d None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:16.114214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 523/1072] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:16.138192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:16.158564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:16.159474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.159762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.160043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.161256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] RBAC: Authorizing `identity:get_project(project_id=ba5fd1871157491bb20ab59ff3a32e0e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:16.162757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:16.164687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 550/1073] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:15 2022] GET /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:16.170360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:16.193020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:16.254355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c31bc-9271-48d5-9e9c-5f2fbae49bfa None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:16.274160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631f38-46f0-4bb9-b700-474d6d08514b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:16.291721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:16.292417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.292795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.293146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.298064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:16.310985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:16.311735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.312099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.312449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.313376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e, user.id=47761f1521e842c0ac3b5d4ec5571cf2) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:16.313769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:16.315490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:16.322406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 551/1074] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:16 2022] GET /identity/v3/role_assignments?user.id=47761f1521e842c0ac3b5d4ec5571cf2&scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:16.378978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:16.380468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:16.493553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 524/1075] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:29:16.499705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:16.588067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:16.605085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3ebb-e8f6-4e94-adda-35d72aa3ced5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:16.640284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:16.641080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.641361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.641630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.652673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:16.654109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-2063ae38-360e-4bfc-86c6-676521bdf323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:16.671348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:16.672283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:16.673193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:16.673193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:16.673193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:16.673193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:16.675016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 552/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:16.678457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:16.714474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:16.786907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ced0-2c4f-442b-893f-65dbde48f157 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:16.824309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:16.824968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:16.825259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:16.825525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:16.826241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:16.826544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:16.827928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ef44c-f52f-4282-b01a-264a593736d7 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:16.843154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 525/1077] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:18.022532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640060f-4167-4e5d-b22d-1cd6a0a412b4 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.023105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640060f-4167-4e5d-b22d-1cd6a0a412b4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.023105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640060f-4167-4e5d-b22d-1cd6a0a412b4 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.024689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 553/1078] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:18.029644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.030061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.030208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.046874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:18.048005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:18.114488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 526/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:18.138676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640060f-4167-4e5d-b22d-1cd6a0a412b4 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.239391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640060f-4167-4e5d-b22d-1cd6a0a412b4 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.272783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d8ac5-4c1a-4805-bf8e-d5f530b944be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.273590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8ac5-4c1a-4805-bf8e-d5f530b944be None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.273874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8ac5-4c1a-4805-bf8e-d5f530b944be None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.274398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8ac5-4c1a-4805-bf8e-d5f530b944be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.277028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:18.285184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d8ac5-4c1a-4805-bf8e-d5f530b944be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-829d8ac5-4c1a-4805-bf8e-d5f530b944be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:18.293403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:18.294461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:18.295856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 554/1080] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:18.300684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.328642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:18.376688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1fb9a-3a72-4061-8205-23f8be7f3fb9 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.376977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1fb9a-3a72-4061-8205-23f8be7f3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.377260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1fb9a-3a72-4061-8205-23f8be7f3fb9 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.378656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 555/1081] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:29:18.383644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229596-a533-4012-9859-3cce4a65f74e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.384008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229596-a533-4012-9859-3cce4a65f74e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.384312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229596-a533-4012-9859-3cce4a65f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.400705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-17229596-a533-4012-9859-3cce4a65f74e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:18.401913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-17229596-a533-4012-9859-3cce4a65f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:18.404729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b0c82-41e0-4916-b251-9493a2123c37 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.439500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.440162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.440444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.440720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.441469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:18.441777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:18.443171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:18.451292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 527/1082] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:18.456827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.470008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 556/1083] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:29:18.493572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17229596-a533-4012-9859-3cce4a65f74e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.543535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:18.556064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edc7bd-8e0e-43bf-8e4a-043353acd48a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.589570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.590358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.590642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.590945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.593445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17229596-a533-4012-9859-3cce4a65f74e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.600991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:18.603111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:18.619535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:18.621070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:18.621999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:18.623277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:18.623277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:18.623277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:18.623277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:18.623277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 528/1084] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:18.627897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.632492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.633283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.633720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.634033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.644237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:18.652886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:18.653896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:18.654777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 557/1085] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:18.659949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.725824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd784c2-8d90-44b9-881f-06ab79c001ff None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.757057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee619-6d21-4771-b02b-c66a4924f12f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.760750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.761415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.761697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.761969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.762709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:18.763052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:18.764408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:18.773104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:18.777423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 529/1086] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:18.783060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.793195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.793934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.794220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.794492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.795281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:18.795584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:18.796941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:18.805088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 558/1087] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:18.811160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.860534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:18.882899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e5de-210f-403b-ae64-03c08208a004 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.909892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002382b-060c-4d4f-9a80-2d91a4a78cb8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:18.917627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.918415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.918714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.918993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.926326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:18.927817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:29:18.941682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:18.942794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:18.944318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 530/1088] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:18.945062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:18.945062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:18.945062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:18.945305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] PATH_INFO: `/v3/users/47761f1521e842c0ac3b5d4ec5571cf2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:18.946474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] RBAC: Authorizing `identity:get_user(user_id=47761f1521e842c0ac3b5d4ec5571cf2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:18.948022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:18.948671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:18.949750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 559/1089] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/users/47761f1521e842c0ac3b5d4ec5571cf2 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:18.955379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:19.006845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:19.048099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc64e77-dda3-405b-ad42-df1cd56103dc None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.053175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a8fa-97ef-4a68-89f6-6a9b4caa0f29 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.068691 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:19.082228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.085570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.085570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.085570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.085570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:19.085570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.085930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.086059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.087314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.087597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.087873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.089060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] RBAC: Authorizing `identity:get_project(project_id=ba5fd1871157491bb20ab59ff3a32e0e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.090482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.092301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 560/1090] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:19.098218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:19.109920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 531/1091] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Jul 21 10:29:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:29:19.110975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:19.198803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0659b-c38e-4383-a956-ecc598cf3b3c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.208417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10da04-2d59-4c12-aeaa-35aa25ef12c1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.226329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:19.233127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.234024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.234300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.235643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e/users/47761f1521e842c0ac3b5d4ec5571cf2/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.236597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba5fd1871157491bb20ab59ff3a32e0e, user_id=47761f1521e842c0ac3b5d4ec5571cf2, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.238038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.242609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.243346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.243628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.243899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.309337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.310805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.349727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 561/1092] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:29:19 2022] PUT /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e/users/47761f1521e842c0ac3b5d4ec5571cf2/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:29:19.423046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 532/1093] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:29:19.429186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:19.479053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:19.537518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748eb55-c550-4c59-8256-6f9c9e0d85c6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.571094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.571890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.572199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.572477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.583664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.585126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:19.603495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:19.604653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:19.605947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:29:19.605947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:19.605947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:29:19.605947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:19.605947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 562/1094] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:29:19.610285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:19.629176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:19.709443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e539-5d32-42be-810e-26f1d79225bd None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.742462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.743856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.744220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.744496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.745215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:19.745520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.746902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.758063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 533/1095] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:19.764101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:19.859916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:19.865586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8de9-dc85-42ce-85f6-8c0337678043 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:19.904535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:19.905324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:19.905605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:19.905877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:19.912422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:19.913887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:29:19.928433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:19.929373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:19.931357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 563/1096] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:19.936182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:20.014619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:20.035419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82236077-9f19-4ec7-8473-b750f34aa290 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:20.070040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:20.070713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:20.071040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:20.071507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:20.072468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:20.072778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:20.074205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcf390-e23b-4291-8b47-a73705ff4ceb None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:20.086223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 534/1097] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:20.092455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:20.190557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3696-668f-4ec4-bde4-7ad444afabe7 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:20.223098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:20.223733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:20.229129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:20.229129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:20.229129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] RBAC: Adding query filter params (role.id=509708b5cd674858b1b72ae85c8440f1, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0be525488dbf496cb0440dc4b046df85) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:20.229129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:20.229129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883514-397c-4406-bbc6-5211f283f72e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:20.233753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 564/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:20 2022] GET /identity/v3/role_assignments?user.id=0be525488dbf496cb0440dc4b046df85&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=509708b5cd674858b1b72ae85c8440f1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:21.381627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559a0cf-7403-4a20-964c-2f87d05201fd None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:21.382188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559a0cf-7403-4a20-964c-2f87d05201fd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:21.382188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559a0cf-7403-4a20-964c-2f87d05201fd None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:21.383572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 535/1099] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:21.388677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:21.389060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:21.389227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:21.405687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:21.406907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:21.421124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:21.471838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 565/1100] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:21.496091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559a0cf-7403-4a20-964c-2f87d05201fd None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:21.592971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559a0cf-7403-4a20-964c-2f87d05201fd None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:21.626012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:21.626806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:21.627086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:21.627359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:21.633983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:21.637636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:21.645137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:21.646234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:21.647196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 536/1101] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:21.652212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:21.749240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700c140-4da9-402f-948f-ccc5e2ae6e03 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:21.781683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:21.782347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:21.782627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:21.782927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:21.783670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:21.783971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:21.785326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:21.794106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 566/1102] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:21.799921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:21.897702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b652f4-7e42-4788-a7e7-db93ee0ecb10 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:21.930969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:21.931813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:21.932090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:21.932356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] PATH_INFO: `/v3/users/47761f1521e842c0ac3b5d4ec5571cf2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:21.933522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=47761f1521e842c0ac3b5d4ec5571cf2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:21.934958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:21.936545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 537/1103] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:21 2022] GET /identity/v3/users/47761f1521e842c0ac3b5d4ec5571cf2 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:21.942323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:21.957810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:22.041217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322c54-a297-4481-a878-35ab15c2e1a8 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:22.074675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:22.075349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:22.075638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:22.075916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:22.142510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:22.143982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:22.156955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:22.240395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 567/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:29:22.247121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:22.309849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:22.343705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780956-e901-4519-8e26-2b490473c1c2 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:22.377287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7b600-051c-44dd-8413-a17d3d215bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:22.378135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b600-051c-44dd-8413-a17d3d215bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:22.378418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b600-051c-44dd-8413-a17d3d215bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:22.378720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b600-051c-44dd-8413-a17d3d215bd2 None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:22.379894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7b600-051c-44dd-8413-a17d3d215bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=ba5fd1871157491bb20ab59ff3a32e0e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:22.381305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7b600-051c-44dd-8413-a17d3d215bd2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:22.383014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 538/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:22 2022] GET /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:22.389025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:22.485052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0029c9-150b-41e5-b3a8-88bd4b392950 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:22.498104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:22.518151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:22.518817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:22.519100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:22.519371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:22.520194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e, user.id=47761f1521e842c0ac3b5d4ec5571cf2) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:22.520501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:22.521913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a1f0-7bce-4508-b697-c54856a9ffa5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:22.528092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 568/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:22 2022] GET /identity/v3/role_assignments?user.id=47761f1521e842c0ac3b5d4ec5571cf2&scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:24.640541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610afe-f3cc-46a8-a5b0-0d822996ca39 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:24.641105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610afe-f3cc-46a8-a5b0-0d822996ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:24.641105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610afe-f3cc-46a8-a5b0-0d822996ca39 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:24.642431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 539/1107] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:24.647693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:24.648128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:24.648239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:24.665326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:24.666517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:24.731917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 569/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:24.757191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2610afe-f3cc-46a8-a5b0-0d822996ca39 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:24.857029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2610afe-f3cc-46a8-a5b0-0d822996ca39 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:24.888691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a030b-8d43-47cb-b372-8bf5f2414883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:24.889468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a030b-8d43-47cb-b372-8bf5f2414883 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:24.889748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a030b-8d43-47cb-b372-8bf5f2414883 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:24.890020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a030b-8d43-47cb-b372-8bf5f2414883 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:24.891249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a030b-8d43-47cb-b372-8bf5f2414883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:24.892620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a030b-8d43-47cb-b372-8bf5f2414883 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:24.894212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 540/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:24.900477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:24.996147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303e8d-a6e4-4a9d-836f-d5ebb8403a20 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:25.003115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:25.028888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae12ff-a82d-4535-b831-c954ccec9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:25.029550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae12ff-a82d-4535-b831-c954ccec9dcd None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:25.029831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae12ff-a82d-4535-b831-c954ccec9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:25.030107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae12ff-a82d-4535-b831-c954ccec9dcd None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:25.030849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae12ff-a82d-4535-b831-c954ccec9dcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:25.032274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae12ff-a82d-4535-b831-c954ccec9dcd None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:25.108063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 570/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:29:24 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:29:27.203099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882d28f-9f13-4128-a31b-f15473b8296d None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:27.203653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882d28f-9f13-4128-a31b-f15473b8296d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:27.203653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882d28f-9f13-4128-a31b-f15473b8296d None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:27.205013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 541/1111] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:27.210522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:27.211000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:27.211093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:27.227692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:27.229010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:27.293834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 571/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:27.317432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882d28f-9f13-4128-a31b-f15473b8296d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:27.320275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:27.417493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882d28f-9f13-4128-a31b-f15473b8296d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:27.474382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:27.474382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:27.474382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:27.474382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] PATH_INFO: `/v3/roles/934aebd972524ff69425bd080d013143` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:27.475647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] RBAC: Authorizing `identity:get_role(role_id=934aebd972524ff69425bd080d013143)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:27.475647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:27.475647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 542/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:27 2022] GET /identity/v3/roles/934aebd972524ff69425bd080d013143 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:27.475905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:27.553114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:27.562026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9242c34-b9a5-46d5-b594-c912a3c49eaf None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:27.595162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:27.596022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:27.596308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:27.596583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] PATH_INFO: `/v3/users/c87588fdf4fe4bfca84f33d57735de76` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:27.609881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] RBAC: Authorizing `identity:get_user(user_id=c87588fdf4fe4bfca84f33d57735de76)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:27.611341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:27.612985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 572/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:27 2022] GET /identity/v3/users/c87588fdf4fe4bfca84f33d57735de76 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:27.619756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:27.687587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:27.716495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff1923-fc87-4b5e-9183-1a0fabc3ad79 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:27.751627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:27.752215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:27.752497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:27.752772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:27.818177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:27.819639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:27.884974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:27.915745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 543/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:29:27.921625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:28.018756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3c1c8-f779-47fb-aae5-88836a3abe58 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:28.052162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24362518-2cfc-403d-a108-fe750613ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:28.053006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362518-2cfc-403d-a108-fe750613ac14 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:28.053289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362518-2cfc-403d-a108-fe750613ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:28.053565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362518-2cfc-403d-a108-fe750613ac14 None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:28.054769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24362518-2cfc-403d-a108-fe750613ac14 None admin] RBAC: Authorizing `identity:get_project(project_id=ba5fd1871157491bb20ab59ff3a32e0e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:28.056194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24362518-2cfc-403d-a108-fe750613ac14 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:28.057964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 573/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:27 2022] GET /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:28.064178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:28.160662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c81b-97a7-409b-afe8-63bd410cdbf3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:28.193164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:28.193806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:28.194091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:28.194370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:28.195233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] RBAC: Adding query filter params (role.id=934aebd972524ff69425bd080d013143, scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e, user.id=c87588fdf4fe4bfca84f33d57735de76) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:28.195546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:28.196962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903e0fc-f459-44c7-8e5b-cf9363c8de85 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:28.203367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 544/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:28 2022] GET /identity/v3/role_assignments?user.id=c87588fdf4fe4bfca84f33d57735de76&scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e&role.id=934aebd972524ff69425bd080d013143 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:30.219991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865998e9-9539-4798-a633-d92e716dcde1 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:30.220548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865998e9-9539-4798-a633-d92e716dcde1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:30.220548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865998e9-9539-4798-a633-d92e716dcde1 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:30.221919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 574/1118] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:30.227419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:30.227815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:30.227977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:30.245136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:30.246352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:30.272225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:30.311634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 545/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:30.334851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865998e9-9539-4798-a633-d92e716dcde1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:30.354028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:30.433217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865998e9-9539-4798-a633-d92e716dcde1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:30.466854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:30.467695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:30.467978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:30.468253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] PATH_INFO: `/v3/roles/934aebd972524ff69425bd080d013143` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:30.469720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] RBAC: Authorizing `identity:get_role(role_id=934aebd972524ff69425bd080d013143)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:30.471168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:30.472477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 575/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:30 2022] GET /identity/v3/roles/934aebd972524ff69425bd080d013143 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:30.478460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:30.574323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b8724-cbef-4ea7-aefe-fea1a2b7d309 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:30.607537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:30.608399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:30.608684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:30.608962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] PATH_INFO: `/v3/users/c87588fdf4fe4bfca84f33d57735de76` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:30.610156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] RBAC: Authorizing `identity:get_user(user_id=c87588fdf4fe4bfca84f33d57735de76)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:30.611614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:30.613221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 546/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:30 2022] GET /identity/v3/users/c87588fdf4fe4bfca84f33d57735de76 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:30.618938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:30.700936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:30.715699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4989-2096-468b-a6d0-326ae515f290 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:30.749864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be83311-1783-4d57-a20c-c0d148600932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:30.750645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be83311-1783-4d57-a20c-c0d148600932 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:30.750962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be83311-1783-4d57-a20c-c0d148600932 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:30.751238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be83311-1783-4d57-a20c-c0d148600932 None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:30.752416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be83311-1783-4d57-a20c-c0d148600932 None admin] RBAC: Authorizing `identity:get_project(project_id=ba5fd1871157491bb20ab59ff3a32e0e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:30.753844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be83311-1783-4d57-a20c-c0d148600932 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:30.755578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 576/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:30 2022] GET /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:30.762127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:30.792784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:30.860116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8eea4-1abd-4947-a19d-41222159ea91 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:30.893751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66c84f-997f-4c96-9b90-b9d87cf97fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:30.894632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66c84f-997f-4c96-9b90-b9d87cf97fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:30.894945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66c84f-997f-4c96-9b90-b9d87cf97fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:30.895221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66c84f-997f-4c96-9b90-b9d87cf97fb6 None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e/users/c87588fdf4fe4bfca84f33d57735de76/roles/934aebd972524ff69425bd080d013143` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:30.897423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66c84f-997f-4c96-9b90-b9d87cf97fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba5fd1871157491bb20ab59ff3a32e0e, user_id=c87588fdf4fe4bfca84f33d57735de76, role_id=934aebd972524ff69425bd080d013143)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:30.898886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66c84f-997f-4c96-9b90-b9d87cf97fb6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:30.955462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 547/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:29:30 2022] PUT /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e/users/c87588fdf4fe4bfca84f33d57735de76/roles/934aebd972524ff69425bd080d013143 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:29:32.949293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1852d-0a83-477f-bdaa-43af8f3f7727 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:32.949847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1852d-0a83-477f-bdaa-43af8f3f7727 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:32.949847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1852d-0a83-477f-bdaa-43af8f3f7727 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:32.951273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 577/1124] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:32.956365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:32.956734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:32.956924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:32.974183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:32.975664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:33.039714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 548/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:33.063096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1852d-0a83-477f-bdaa-43af8f3f7727 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:33.160908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1852d-0a83-477f-bdaa-43af8f3f7727 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:33.193599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:33.194432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:33.194730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:33.195006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] PATH_INFO: `/v3/roles/934aebd972524ff69425bd080d013143` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:33.196458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] RBAC: Authorizing `identity:get_role(role_id=934aebd972524ff69425bd080d013143)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:33.197807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:33.199333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 578/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:33 2022] GET /identity/v3/roles/934aebd972524ff69425bd080d013143 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:33.205392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:33.229089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:33.302878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89930-2343-4989-8d71-c5c2335593f2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:33.335577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:33.336427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:33.336709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:33.336982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] PATH_INFO: `/v3/users/c87588fdf4fe4bfca84f33d57735de76` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:33.338150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] RBAC: Authorizing `identity:get_user(user_id=c87588fdf4fe4bfca84f33d57735de76)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:33.340218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:33.341819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 549/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:33 2022] GET /identity/v3/users/c87588fdf4fe4bfca84f33d57735de76 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:33.347501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:33.371400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:33.444133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c1ca-c0ca-479b-aea1-249815fa59d5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:33.477489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:33.478120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:33.478403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:33.478679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:33.543627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:33.545048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:33.566839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:33.640545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 579/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:29:33.646351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:33.735324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:33.744699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668009ee-b293-4801-9ec8-f407fb989b97 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:33.779083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e67f9a-9943-4202-af44-f50bab1941a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:33.779950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e67f9a-9943-4202-af44-f50bab1941a8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:33.780241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e67f9a-9943-4202-af44-f50bab1941a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:33.780518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e67f9a-9943-4202-af44-f50bab1941a8 None admin] PATH_INFO: `/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:33.781708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e67f9a-9943-4202-af44-f50bab1941a8 None admin] RBAC: Authorizing `identity:get_project(project_id=ba5fd1871157491bb20ab59ff3a32e0e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:33.783230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e67f9a-9943-4202-af44-f50bab1941a8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:33.784891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 550/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:33 2022] GET /identity/v3/projects/ba5fd1871157491bb20ab59ff3a32e0e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:33.790944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:33.887508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1bd0-4c75-48fb-b599-ae51b2bdc898 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:33.908988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:33.920001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:33.929466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:33.929466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:33.929466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:33.929466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] RBAC: Adding query filter params (role.id=934aebd972524ff69425bd080d013143, scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e, user.id=c87588fdf4fe4bfca84f33d57735de76) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:33.929466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:33.929466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacd6fb-dc5a-47a9-a530-83de4bc999f4 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:33.930046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 580/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:33 2022] GET /identity/v3/role_assignments?user.id=c87588fdf4fe4bfca84f33d57735de76&scope.project.id=ba5fd1871157491bb20ab59ff3a32e0e&role.id=934aebd972524ff69425bd080d013143 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:35.972020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146ccb-b149-471a-bbea-c597e8d62745 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:35.972572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146ccb-b149-471a-bbea-c597e8d62745 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:35.972572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146ccb-b149-471a-bbea-c597e8d62745 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:35.973937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 551/1131] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:35.980131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:35.980596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:35.980877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:35.997124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:35.998301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:36.065016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 581/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:36.088081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56146ccb-b149-471a-bbea-c597e8d62745 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:36.187931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56146ccb-b149-471a-bbea-c597e8d62745 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:36.220983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5223db-97da-4377-afff-e424a21695ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:36.221763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5223db-97da-4377-afff-e424a21695ae None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:36.222048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5223db-97da-4377-afff-e424a21695ae None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:36.222326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5223db-97da-4377-afff-e424a21695ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:36.223525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5223db-97da-4377-afff-e424a21695ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:36.224957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5223db-97da-4377-afff-e424a21695ae None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:36.226844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 552/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:36.233403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:36.329331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cf4a-33b1-42ed-8611-328551fd2fed None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:36.345440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:36.362218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7adff2-ffea-41de-bc53-1cc9208a9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:36.362892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7adff2-ffea-41de-bc53-1cc9208a9db8 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:36.363177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7adff2-ffea-41de-bc53-1cc9208a9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:36.363452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7adff2-ffea-41de-bc53-1cc9208a9db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:36.364161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7adff2-ffea-41de-bc53-1cc9208a9db8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:36.365579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7adff2-ffea-41de-bc53-1cc9208a9db8 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:36.447793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 582/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:29:36 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:38.484563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847347f-62b2-4fa3-b92c-42fa61608a20 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:38.485120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847347f-62b2-4fa3-b92c-42fa61608a20 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:38.485120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847347f-62b2-4fa3-b92c-42fa61608a20 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:38.486489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 553/1135] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:38.491535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:38.491936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:38.492087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:38.508487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:38.509673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:38.573899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 583/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:38.598484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847347f-62b2-4fa3-b92c-42fa61608a20 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:38.625346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:38.697535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847347f-62b2-4fa3-b92c-42fa61608a20 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:38.731286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4ba0-42c0-44da-b685-cbcf26b00f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:38.732065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4ba0-42c0-44da-b685-cbcf26b00f3a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:38.732350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4ba0-42c0-44da-b685-cbcf26b00f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:38.732625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4ba0-42c0-44da-b685-cbcf26b00f3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:38.733792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4ba0-42c0-44da-b685-cbcf26b00f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:38.735301 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4ba0-42c0-44da-b685-cbcf26b00f3a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:38.736844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 554/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:38.742457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:38.834874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:38.838521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a55d2-b3d4-428d-81fa-34950970bdf6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:38.873014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce080798-cf7c-48bc-a4e2-bd53045dc7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:38.873674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce080798-cf7c-48bc-a4e2-bd53045dc7b3 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:38.873958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce080798-cf7c-48bc-a4e2-bd53045dc7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:38.874235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce080798-cf7c-48bc-a4e2-bd53045dc7b3 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:38.874971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce080798-cf7c-48bc-a4e2-bd53045dc7b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:38.876394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce080798-cf7c-48bc-a4e2-bd53045dc7b3 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:38.976738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 584/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:29:38 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:41.040715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c33a6-1175-417a-88f8-b5fb5a7765bf None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:41.041204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c33a6-1175-417a-88f8-b5fb5a7765bf None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:41.041204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c33a6-1175-417a-88f8-b5fb5a7765bf None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:41.042555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 555/1139] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:41.047781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:41.048173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:41.048341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:41.064875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:41.066064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:41.131412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 585/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:41.155369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c33a6-1175-417a-88f8-b5fb5a7765bf None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:41.247424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:41.254907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c33a6-1175-417a-88f8-b5fb5a7765bf None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:41.287693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:41.288467 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:41.288748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:41.289018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:41.298804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:41.306354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:41.307460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:41.308502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 556/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:41.314150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:41.393572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:41.408218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04078572-0c91-4c64-9737-8d350244f5bb None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:41.440543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:41.441999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:41.441999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:41.441999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:41.442446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:41.442781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:41.444141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:41.452552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 586/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:41.458195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:41.555028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e59fb-b004-4ff4-86e5-3ae66750a284 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:41.587549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:41.588406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:41.588689 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:41.588966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] PATH_INFO: `/v3/users/70687d26d4a04400ac1c4cec256b257a` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:41.602435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] RBAC: Authorizing `identity:get_user(user_id=70687d26d4a04400ac1c4cec256b257a)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:41.603902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:41.605513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 557/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:41 2022] GET /identity/v3/users/70687d26d4a04400ac1c4cec256b257a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:41.611824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:41.708605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aecc3-1ba5-4fc3-aca5-3885a3dc32db None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:41.741204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:41.741836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:41.742117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:41.742391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:41.757569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:41.808611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:41.810840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:41.905185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 587/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:29:41.911087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:41.925801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:42.007864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6413b78-658f-4d8e-ad70-a2623c874be0 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:42.040488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5776-3561-48a6-8fea-42ef508c2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:42.041330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5776-3561-48a6-8fea-42ef508c2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:42.041898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5776-3561-48a6-8fea-42ef508c2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:42.041898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5776-3561-48a6-8fea-42ef508c2dd2 None admin] PATH_INFO: `/v3/projects/3416720ce2354d579e5a7a238b07e20a` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:42.043050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b5776-3561-48a6-8fea-42ef508c2dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=3416720ce2354d579e5a7a238b07e20a)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:42.045079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b5776-3561-48a6-8fea-42ef508c2dd2 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:42.046762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 558/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:41 2022] GET /identity/v3/projects/3416720ce2354d579e5a7a238b07e20a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:42.052802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:42.098023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:42.149412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00b039-0a8b-4f5a-9cc6-6adcf6657e97 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:42.182798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:42.183448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:42.183748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:42.184007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:42.184844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=3416720ce2354d579e5a7a238b07e20a, user.id=70687d26d4a04400ac1c4cec256b257a) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:42.185159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:42.186585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7847a-e151-4448-aa2e-01031a92fb92 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:42.191926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 588/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:42 2022] GET /identity/v3/role_assignments?user.id=70687d26d4a04400ac1c4cec256b257a&scope.project.id=3416720ce2354d579e5a7a238b07e20a&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:44.191664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d914-326e-421a-aa34-8714f51bc313 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:44.192211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d914-326e-421a-aa34-8714f51bc313 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:44.192211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d914-326e-421a-aa34-8714f51bc313 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:44.193565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 559/1147] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:44.198703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:44.199110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:44.199273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:44.216831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:44.218025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:44.283017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 589/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:44.305619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d914-326e-421a-aa34-8714f51bc313 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:44.385760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:44.405268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d914-326e-421a-aa34-8714f51bc313 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:44.438713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:44.439513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:44.439800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:44.440076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:44.452444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:44.458086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:44.459184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:44.460308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 560/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:44.466003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:44.506481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:44.563264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fef36-ab98-459b-ab33-007a7ab828c5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:44.596838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:44.597489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:44.597767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:44.598039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:44.598806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:44.599116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:44.600473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:44.608800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 590/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:44.614608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:44.711982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748520a5-b14b-4f63-8cb1-8fb96dbc22f4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:44.744558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:44.745408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:44.745689 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:44.745962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] PATH_INFO: `/v3/users/70687d26d4a04400ac1c4cec256b257a` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:44.747212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] RBAC: Authorizing `identity:get_user(user_id=70687d26d4a04400ac1c4cec256b257a)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:44.748643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:44.750228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 561/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:44 2022] GET /identity/v3/users/70687d26d4a04400ac1c4cec256b257a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:44.756247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:44.854101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f304d2-c99b-45ad-969f-4be6cf5585ed None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:44.855630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:44.886736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11fecd-4fa6-46e8-8df5-1f5d5d6b8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:44.888199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11fecd-4fa6-46e8-8df5-1f5d5d6b8d36 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:44.888476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11fecd-4fa6-46e8-8df5-1f5d5d6b8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:44.888750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11fecd-4fa6-46e8-8df5-1f5d5d6b8d36 None admin] PATH_INFO: `/v3/projects/3416720ce2354d579e5a7a238b07e20a` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:44.889927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11fecd-4fa6-46e8-8df5-1f5d5d6b8d36 None admin] RBAC: Authorizing `identity:get_project(project_id=3416720ce2354d579e5a7a238b07e20a)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:44.891392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11fecd-4fa6-46e8-8df5-1f5d5d6b8d36 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:44.893093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 591/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:44 2022] GET /identity/v3/projects/3416720ce2354d579e5a7a238b07e20a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:44.899116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:44.910845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:44.996574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0601e-70ed-4ef3-952c-dd622dbb0e65 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:45.029843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae63b9a-b5a9-448d-acd6-fa8c1c2f9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:45.030736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae63b9a-b5a9-448d-acd6-fa8c1c2f9878 None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:45.031041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae63b9a-b5a9-448d-acd6-fa8c1c2f9878 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:45.031314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae63b9a-b5a9-448d-acd6-fa8c1c2f9878 None admin] PATH_INFO: `/v3/projects/3416720ce2354d579e5a7a238b07e20a/users/70687d26d4a04400ac1c4cec256b257a/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:45.033250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae63b9a-b5a9-448d-acd6-fa8c1c2f9878 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416720ce2354d579e5a7a238b07e20a, user_id=70687d26d4a04400ac1c4cec256b257a, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:45.034675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae63b9a-b5a9-448d-acd6-fa8c1c2f9878 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:45.136724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 562/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:29:44 2022] PUT /identity/v3/projects/3416720ce2354d579e5a7a238b07e20a/users/70687d26d4a04400ac1c4cec256b257a/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:29:47.155799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f4fa-d6d4-4c32-8853-6f153be476c5 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.156349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f4fa-d6d4-4c32-8853-6f153be476c5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.156349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f4fa-d6d4-4c32-8853-6f153be476c5 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.157735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 592/1154] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:47.162928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.163365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.163469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.179612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:47.180778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:47.241457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:47.246752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 563/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:47.270618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f4fa-d6d4-4c32-8853-6f153be476c5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:47.369062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f4fa-d6d4-4c32-8853-6f153be476c5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:47.401819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:47.402596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.402902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.403176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.413433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:29:47.421104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:47.422198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:29:47.423272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 593/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:47.428208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:47.524302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd197f60-235b-4a81-a0ce-43494db9d249 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:47.557673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:47.558328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.558611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.558912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.559660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:47.559965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:47.561979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:47.569799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 564/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:47.575599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:47.605286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:47.671925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34b18-dc85-4c6b-8d1a-92bda9111d11 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:47.704273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:47.705113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.705395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.705665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] PATH_INFO: `/v3/users/70687d26d4a04400ac1c4cec256b257a` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.706857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=70687d26d4a04400ac1c4cec256b257a)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:47.708266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:47.709872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 594/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:29:47 2022] GET /identity/v3/users/70687d26d4a04400ac1c4cec256b257a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:47.715599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:47.773291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:47.814359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda646-53af-45c5-b45a-fd2519a2a06b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:47.846118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:47.846789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:47.847073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:47.847348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:47.913217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:47.914648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:47.971316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:48.011592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 565/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:29:48.017828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:48.111602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:48.115849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38933d-a985-4694-9938-ae74618d9ea5 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:48.148823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c71d4-9303-44bd-b269-f6f988fe5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:48.149659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c71d4-9303-44bd-b269-f6f988fe5414 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:48.149944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c71d4-9303-44bd-b269-f6f988fe5414 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:48.150418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c71d4-9303-44bd-b269-f6f988fe5414 None admin] PATH_INFO: `/v3/projects/3416720ce2354d579e5a7a238b07e20a` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:48.152085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c71d4-9303-44bd-b269-f6f988fe5414 None admin] RBAC: Authorizing `identity:get_project(project_id=3416720ce2354d579e5a7a238b07e20a)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:48.153532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c71d4-9303-44bd-b269-f6f988fe5414 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:48.155896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 595/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:29:48 2022] GET /identity/v3/projects/3416720ce2354d579e5a7a238b07e20a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:48.161974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:48.259264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022989c-1b7f-497d-869f-6b57e54011a4 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:48.293618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:48.294251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:48.294532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:48.295914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:48.296751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=3416720ce2354d579e5a7a238b07e20a, user.id=70687d26d4a04400ac1c4cec256b257a) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:48.297060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:48.298512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb0854-ce82-4332-9e3e-d07de3b74d86 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:48.304187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 566/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:29:48 2022] GET /identity/v3/role_assignments?user.id=70687d26d4a04400ac1c4cec256b257a&scope.project.id=3416720ce2354d579e5a7a238b07e20a&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:50.352246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8d955-0df6-4cfc-b952-e14d09245648 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:50.352883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8d955-0df6-4cfc-b952-e14d09245648 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:50.352883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8d955-0df6-4cfc-b952-e14d09245648 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:50.354155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 596/1162] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:50.360003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:50.360431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:50.360536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:50.376928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:50.378123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:50.395246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:50.443912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 567/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:50.466169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8d955-0df6-4cfc-b952-e14d09245648 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:50.565244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8d955-0df6-4cfc-b952-e14d09245648 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:50.598590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:50.599251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:50.599532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:50.599805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:50.631790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:50.664796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:50.666234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:50.760572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 597/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:29:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:29:50.767072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:50.863865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca29c5-0491-4e5b-9749-0a78ddead230 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:50.897158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:50.897890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:50.898170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:50.898443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:50.904923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:50.906336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-e88a88e7-2e30-480c-97aa-d0a14ad8c8fa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:29:50.920190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:29:50.921460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:29:50.922629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 568/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:29:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:29:50.927308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:50.990702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:51.024072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa909-9d21-4223-862f-9d6c079edd2b None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:51.056944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:51.057593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:51.057874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:51.058145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:51.058887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:29:51.059192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:51.061060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155bc58-71ef-4c30-a17a-09cdc8e6c4a9 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:51.068203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 598/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Jul 21 10:29:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:53.076840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe6e3-89e9-4380-a6b3-ebe529603c2a None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:53.077373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe6e3-89e9-4380-a6b3-ebe529603c2a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:53.077373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe6e3-89e9-4380-a6b3-ebe529603c2a None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:53.078776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 569/1167] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:53.083952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522dc53-4d73-4e73-ace2-89fa292d2d87 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:53.084362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522dc53-4d73-4e73-ace2-89fa292d2d87 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:53.084511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522dc53-4d73-4e73-ace2-89fa292d2d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:53.100812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b522dc53-4d73-4e73-ace2-89fa292d2d87 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:53.102271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b522dc53-4d73-4e73-ace2-89fa292d2d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:53.167376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 599/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:53.190598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabe6e3-89e9-4380-a6b3-ebe529603c2a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:53.207575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:53.291717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabe6e3-89e9-4380-a6b3-ebe529603c2a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:53.324683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6fa49-fa4a-41ba-ad16-ea9c32830f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:53.325324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6fa49-fa4a-41ba-ad16-ea9c32830f2a None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:53.325603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6fa49-fa4a-41ba-ad16-ea9c32830f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:53.325872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6fa49-fa4a-41ba-ad16-ea9c32830f2a None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:53.326969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6fa49-fa4a-41ba-ad16-ea9c32830f2a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:53.328266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6fa49-fa4a-41ba-ad16-ea9c32830f2a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:53.395574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 570/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Thu Jul 21 10:29:53 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:55.455614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b6e5-5cfa-4c15-b7cb-31e832dc29ac None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:55.456172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b6e5-5cfa-4c15-b7cb-31e832dc29ac None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:55.456172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b6e5-5cfa-4c15-b7cb-31e832dc29ac None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:55.457582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 600/1170] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:55.462683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:55.463110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:55.463255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:55.480539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:55.481718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:55.546508 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 571/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:55.570429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b6e5-5cfa-4c15-b7cb-31e832dc29ac None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:55.629434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:55.669362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b6e5-5cfa-4c15-b7cb-31e832dc29ac None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:55.702016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a1f4c-c960-4e5e-8359-5684eec0bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:55.702891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a1f4c-c960-4e5e-8359-5684eec0bc82 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:55.703180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a1f4c-c960-4e5e-8359-5684eec0bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:55.703457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a1f4c-c960-4e5e-8359-5684eec0bc82 None admin] PATH_INFO: `/v3/domains/44784f2bce2044b38f41c871f4be328b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:55.713537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a1f4c-c960-4e5e-8359-5684eec0bc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=44784f2bce2044b38f41c871f4be328b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:55.714942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a1f4c-c960-4e5e-8359-5684eec0bc82 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:55.716552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 601/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Thu Jul 21 10:29:55 2022] GET /identity/v3/domains/44784f2bce2044b38f41c871f4be328b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:55.723348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:55.726624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:55.819909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb37d-d836-41d1-b132-bdcb0e4e10e5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:55.854122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac38da-5702-4aff-b998-e0248b5d116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:55.854899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac38da-5702-4aff-b998-e0248b5d116a None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:55.855184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac38da-5702-4aff-b998-e0248b5d116a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:55.855480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac38da-5702-4aff-b998-e0248b5d116a None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:55.856181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac38da-5702-4aff-b998-e0248b5d116a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:55.857617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac38da-5702-4aff-b998-e0248b5d116a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:55.931967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 572/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:29:55 2022] POST /identity/v3/projects => generated 361 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:29:57.978121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477860f-e134-4823-8857-f7e5caa54f24 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:57.978669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477860f-e134-4823-8857-f7e5caa54f24 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:57.978669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477860f-e134-4823-8857-f7e5caa54f24 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:57.980092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 602/1174] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:29:57.985437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:57.985860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:57.985992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:58.002954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:29:58.004122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:29:58.054404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:58.071019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 573/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:29:58.095348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477860f-e134-4823-8857-f7e5caa54f24 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:58.195979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477860f-e134-4823-8857-f7e5caa54f24 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:58.214600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:29:58.228085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c77a-14b4-42d9-9a56-95692b03c76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:58.228938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c77a-14b4-42d9-9a56-95692b03c76a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:58.229219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c77a-14b4-42d9-9a56-95692b03c76a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:58.229494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c77a-14b4-42d9-9a56-95692b03c76a None admin] PATH_INFO: `/v3/domains/44784f2bce2044b38f41c871f4be328b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:58.230663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c77a-14b4-42d9-9a56-95692b03c76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=44784f2bce2044b38f41c871f4be328b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:58.232126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c77a-14b4-42d9-9a56-95692b03c76a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:58.234847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 603/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Thu Jul 21 10:29:58 2022] GET /identity/v3/domains/44784f2bce2044b38f41c871f4be328b => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:29:58.240573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:29:58.337302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041ffb2-37b3-480b-a4cc-dd555cc55b63 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:29:58.370182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a65dcd-0dcb-4a7d-a442-419cef57f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:29:58.370875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a65dcd-0dcb-4a7d-a442-419cef57f88d None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:29:58.371155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a65dcd-0dcb-4a7d-a442-419cef57f88d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:29:58.371424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a65dcd-0dcb-4a7d-a442-419cef57f88d None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:29:58.372130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a65dcd-0dcb-4a7d-a442-419cef57f88d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:29:58.374386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a65dcd-0dcb-4a7d-a442-419cef57f88d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:29:58.458823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 574/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:29:58 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:30:00.512620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49525639-f86a-4cfe-91d8-2530f910fe48 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:00.513184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49525639-f86a-4cfe-91d8-2530f910fe48 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:00.513184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49525639-f86a-4cfe-91d8-2530f910fe48 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:00.514811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 604/1178] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:30:00.520065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:00.520461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:00.520632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:00.537033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:00.538216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:00.573172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:00.605425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 575/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:30:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:30:00.629555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49525639-f86a-4cfe-91d8-2530f910fe48 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:00.728746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49525639-f86a-4cfe-91d8-2530f910fe48 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:00.761160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:00.761933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:00.762216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:00.762492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:00.772938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:30:00.781010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:30:00.782021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:30:00.783215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 605/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:30:00.788128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:00.884626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2ef34-2227-4e24-be8f-aff429ba59c9 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:00.917234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:00.917885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:00.918167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:00.918440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:00.919211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:30:00.919519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:00.921084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:00.928853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 576/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:00.934498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:00.983281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:01.032048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af20-9bf5-4e68-999e-8b332ff96e8a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:01.065759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:01.066674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:01.066996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:01.067274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] PATH_INFO: `/v3/users/52693111e592492e837bafe25817e0e9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:01.080163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] RBAC: Authorizing `identity:get_user(user_id=52693111e592492e837bafe25817e0e9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:01.081637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:01.083352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 606/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:30:00 2022] GET /identity/v3/users/52693111e592492e837bafe25817e0e9 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:01.089030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:01.123025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:01.187652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1458-8f69-4aa6-bee1-28fd1c2e7269 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:01.219703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:01.220343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:01.220626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:01.220901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:01.352668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:01.354105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:01.386042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:01.449820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 577/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:30:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:30:01.456026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:01.552334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a9a-17dc-42dc-b235-7a148eddaf49 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:01.559290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:01.584694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949727e6-d780-4827-9f95-f225ab2c159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:01.585545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949727e6-d780-4827-9f95-f225ab2c159d None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:01.585827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949727e6-d780-4827-9f95-f225ab2c159d None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:01.586101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949727e6-d780-4827-9f95-f225ab2c159d None admin] PATH_INFO: `/v3/projects/9f6edaf693104bcbad0f568f1d18d669` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:01.587286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949727e6-d780-4827-9f95-f225ab2c159d None admin] RBAC: Authorizing `identity:get_project(project_id=9f6edaf693104bcbad0f568f1d18d669)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:01.588739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949727e6-d780-4827-9f95-f225ab2c159d None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:01.594737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 607/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:30:01 2022] GET /identity/v3/projects/9f6edaf693104bcbad0f568f1d18d669 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:01.597380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:01.692653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98289697-87b2-4866-893c-810b3fcf16a3 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:01.724509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:01.725140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:01.725420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:01.725692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:01.726808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=9f6edaf693104bcbad0f568f1d18d669, user.id=52693111e592492e837bafe25817e0e9) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:30:01.727117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:01.728533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68e33-cede-4e5a-9be4-f6212bf3d562 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:01.730285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:01.734905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 578/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:30:01 2022] GET /identity/v3/role_assignments?user.id=52693111e592492e837bafe25817e0e9&scope.project.id=9f6edaf693104bcbad0f568f1d18d669&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:03.739933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88961c7-9425-4d15-a14b-ee79c977db9e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:03.740504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88961c7-9425-4d15-a14b-ee79c977db9e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:03.740504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88961c7-9425-4d15-a14b-ee79c977db9e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:03.741878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 608/1186] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:30:03.747225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:03.747633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:03.747780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:03.764295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:03.765478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:03.832411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 579/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:30:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:30:03.856021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88961c7-9425-4d15-a14b-ee79c977db9e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:03.956364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88961c7-9425-4d15-a14b-ee79c977db9e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:03.990407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:03.991152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:03.991439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:03.991715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:04.001589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:30:04.009212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:30:04.010302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:30:04.011281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 609/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:30:04.016835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:04.112161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc550e1-7056-4143-8be3-88c17012dc40 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:04.137038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:04.145084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:04.145823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:04.153830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:04.153830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:04.153830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:30:04.153830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:04.153830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:04.157096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 580/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:04.162919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:04.196660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:04.261673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b7fca-a4f3-4a31-8cf2-4a35a4fbaed3 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:04.294960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:04.295823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:04.296105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:04.296383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] PATH_INFO: `/v3/users/52693111e592492e837bafe25817e0e9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:04.297633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] RBAC: Authorizing `identity:get_user(user_id=52693111e592492e837bafe25817e0e9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:04.299093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:04.300729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 610/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:30:04 2022] GET /identity/v3/users/52693111e592492e837bafe25817e0e9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:04.306751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:04.404036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33979f9-2a53-41bf-ac90-f26619ba509a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:04.435678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679a9c-18d4-49b3-bc0b-cba6d2c7c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:04.437023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679a9c-18d4-49b3-bc0b-cba6d2c7c48d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:04.437306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679a9c-18d4-49b3-bc0b-cba6d2c7c48d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:04.437582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679a9c-18d4-49b3-bc0b-cba6d2c7c48d None admin] PATH_INFO: `/v3/projects/9f6edaf693104bcbad0f568f1d18d669` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:04.438776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679a9c-18d4-49b3-bc0b-cba6d2c7c48d None admin] RBAC: Authorizing `identity:get_project(project_id=9f6edaf693104bcbad0f568f1d18d669)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:04.440191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679a9c-18d4-49b3-bc0b-cba6d2c7c48d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:04.441844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 581/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:30:04 2022] GET /identity/v3/projects/9f6edaf693104bcbad0f568f1d18d669 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:04.447743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:04.544308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1aab-d046-4891-a285-5a1d5ae3011e None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:04.545949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:04.578335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01072bb0-c558-4c97-9ec6-db470b8b2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:04.579234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072bb0-c558-4c97-9ec6-db470b8b2587 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:04.579541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072bb0-c558-4c97-9ec6-db470b8b2587 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:04.579816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072bb0-c558-4c97-9ec6-db470b8b2587 None admin] PATH_INFO: `/v3/projects/9f6edaf693104bcbad0f568f1d18d669/users/52693111e592492e837bafe25817e0e9/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:04.581765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01072bb0-c558-4c97-9ec6-db470b8b2587 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6edaf693104bcbad0f568f1d18d669, user_id=52693111e592492e837bafe25817e0e9, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:04.583250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01072bb0-c558-4c97-9ec6-db470b8b2587 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:04.653790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 611/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:30:04 2022] PUT /identity/v3/projects/9f6edaf693104bcbad0f568f1d18d669/users/52693111e592492e837bafe25817e0e9/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:30:06.633682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d610-c022-405b-9873-e9e085651b70 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:06.634216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d610-c022-405b-9873-e9e085651b70 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:06.634216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d610-c022-405b-9873-e9e085651b70 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:06.635611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 582/1193] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:30:06.640792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:06.641183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:06.641356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:06.658207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:30:06.659422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:30:06.723979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 612/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:30:06.747594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d610-c022-405b-9873-e9e085651b70 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:06.808760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:06.849989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d610-c022-405b-9873-e9e085651b70 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:06.883610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:06.884450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:06.884686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:06.884960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:06.894990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:30:06.902664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:30:06.903755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:30:06.905224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 583/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:30:06.910503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:07.002740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:07.011272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04aa78-c4a2-430c-8a67-e6d784ecca85 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:07.045642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:07.046301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:07.046590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:07.046898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:07.047653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:30:07.047963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:07.049332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:07.057230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 613/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:07.063016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:07.161172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdf5b2-f3db-4af6-9459-f4989448b255 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:07.177122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:07.193428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:07.194290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:07.194571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:07.194872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] PATH_INFO: `/v3/users/52693111e592492e837bafe25817e0e9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:07.196059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] RBAC: Authorizing `identity:get_user(user_id=52693111e592492e837bafe25817e0e9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:07.197491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:07.199130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 584/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Jul 21 10:30:07 2022] GET /identity/v3/users/52693111e592492e837bafe25817e0e9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:07.205803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:07.307366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01230-95ae-4f7a-9290-74a106815ef0 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:07.339836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:07.340470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:07.340752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:07.341029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:07.364740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:07.407650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:07.409079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:07.504380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 614/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:30:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:30:07.510137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:07.606536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93cb51-fcf9-44fa-8580-db8f4d35e336 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:07.639336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8c889-b174-4666-a98f-fcb13b39f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:07.640187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8c889-b174-4666-a98f-fcb13b39f38c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:07.640467 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8c889-b174-4666-a98f-fcb13b39f38c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:07.640739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8c889-b174-4666-a98f-fcb13b39f38c None admin] PATH_INFO: `/v3/projects/9f6edaf693104bcbad0f568f1d18d669` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:07.641922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8c889-b174-4666-a98f-fcb13b39f38c None admin] RBAC: Authorizing `identity:get_project(project_id=9f6edaf693104bcbad0f568f1d18d669)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:07.643368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8c889-b174-4666-a98f-fcb13b39f38c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:07.645028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 585/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Jul 21 10:30:07 2022] GET /identity/v3/projects/9f6edaf693104bcbad0f568f1d18d669 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:07.651026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:30:07.705161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:07.748831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e78f4a-483e-481a-b1e2-8b46c21e4fa2 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:30:07.782432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:30:07.783045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:30:07.783709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:30:07.783709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:30:07.784410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=9f6edaf693104bcbad0f568f1d18d669, user.id=52693111e592492e837bafe25817e0e9) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:30:07.784719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:30:07.786148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2a690-ec93-4fdc-aafb-6bd51ef28bd2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:30:07.791955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 615/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:30:07 2022] GET /identity/v3/role_assignments?user.id=52693111e592492e837bafe25817e0e9&scope.project.id=9f6edaf693104bcbad0f568f1d18d669&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:30:17.635116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=73 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:30:17.789297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=41 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:20.568225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c6ee-2f57-4e05-8253-2f5a421bc03a None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:20.568912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c6ee-2f57-4e05-8253-2f5a421bc03a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:20.568912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c6ee-2f57-4e05-8253-2f5a421bc03a None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:20.570342 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 586/1201] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:20.575773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:20.576230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:20.576332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:20.594012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:20.595308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:20.664539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 616/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:20.689335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c6ee-2f57-4e05-8253-2f5a421bc03a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:20.791499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c6ee-2f57-4e05-8253-2f5a421bc03a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:20.824170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:20.824886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:20.825163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:20.825433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:20.836296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:20.837896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:20.856084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:20.857135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:20.858628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:20.858628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:20.858628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:20.858628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:20.858628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 587/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:20.863254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:20.961809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df966d-d922-4a49-9d98-8511f18dabc7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:20.989580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:20.995051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:20.995708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:20.995990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:20.996265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:20.996984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:20.997292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:20.998672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933537b-3878-44e5-99a1-7fce905af14f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:21.010879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 617/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:21.016635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:21.069224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:21.116440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a3c3-55e1-467e-8fdd-9c6cc6ed48de None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:21.149185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bd024-3fff-490c-a8e8-ecc44a6f8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:21.150378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bd024-3fff-490c-a8e8-ecc44a6f8c2d None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:21.150682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bd024-3fff-490c-a8e8-ecc44a6f8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:21.155621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bd024-3fff-490c-a8e8-ecc44a6f8c2d None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:21.155621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bd024-3fff-490c-a8e8-ecc44a6f8c2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:21.155621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bd024-3fff-490c-a8e8-ecc44a6f8c2d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:21.224242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 588/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Jul 21 10:31:21 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:31:23.302501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89b8b-02db-44f8-a917-3e4703e150ef None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:23.303113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89b8b-02db-44f8-a917-3e4703e150ef None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:23.303113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89b8b-02db-44f8-a917-3e4703e150ef None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:23.305248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 618/1206] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:23.310815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:23.311220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:23.311368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:23.328210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:23.329444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:23.395611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 589/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:23.421147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89b8b-02db-44f8-a917-3e4703e150ef None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:23.521680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89b8b-02db-44f8-a917-3e4703e150ef None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:23.555541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:23.556261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:23.556543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:23.556816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:23.566976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:31:23.574996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:23.576067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:23.577078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 619/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:31:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:23.582505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:23.622357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:23.680624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbff384-86d5-41c0-88f4-cb0180bb7dbe None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:23.714644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:23.715328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:23.715607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:23.715883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:23.716632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:23.716964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:23.718313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:23.727271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 590/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:31:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:23.733263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:23.783999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:23.832689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931d59-21ec-4ed5-a0c7-a26a9d07cc3a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:23.866748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:23.867538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:23.867825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:23.868101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:23.878250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:23.879715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:23.901647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:23.902760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:23.903709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:23.903709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:23.903709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:23.903709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:23.903709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 620/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:23.908801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:24.008842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:24.011718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cf5dd-8a39-48e8-a17b-ed7b0351844c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:24.044918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:24.045580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:24.045868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:24.046147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:24.046912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:24.047223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:24.048591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:24.059802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 591/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:24.065404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:24.166646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb27c9-3309-4e90-bfed-c18d10b3bb31 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:24.168111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:24.202711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:24.203535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:24.203820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:24.204094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:24.212106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:24.215523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:31:24.228866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:24.230263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:24.231577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 621/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:24.236175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:24.336910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df9002-8494-43e9-a1f0-3b8cdd9c76e6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:24.370274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:24.370975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:24.371297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:24.371590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:24.372434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:24.372744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:24.374157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:24.391617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 592/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 21 10:31:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:24.397960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:24.497565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496257-4495-49f9-ba92-49fa2f244f3f None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:24.531843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:24.532487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:24.532773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:24.533052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:24.562022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:24.599957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:24.601816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:24.700072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 622/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:31:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:31:24.704940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:24.728237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:24.815815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd809-b9fb-4fa4-afd6-d09304252a37 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:24.853572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:24.854369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:24.854651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:24.855209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:24.867783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:24.870287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:24.890837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:24.891934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:24.893311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:24.893311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:24.893311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:24.893311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:24.893311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 593/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:24.898057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:24.966836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:25.009185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfb27e-12cb-4c30-8428-ca39d749e612 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:25.047913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:25.048476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:25.048762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:25.049040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:25.049771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:25.050080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:25.051515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:25.067700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 623/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:25.074247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:25.153280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:25.188963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc280f-c75c-4e47-8a88-de282757ec7a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:25.233805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:25.234053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:25.234258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:25.234532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:25.245190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:25.246675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:31:25.261250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:25.262447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:25.263588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 594/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:25.269749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:25.391964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe13d-3b93-4b80-bddc-ead716b666db None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:25.421381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:25.433755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:25.434444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:25.434760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:25.435038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:25.435849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:25.436160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:25.437628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b79e2-a57d-4ad8-95a5-11580aea168f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:25.451755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 624/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:25.459214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:25.566962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30d41-383d-4d17-b0af-5eac553c8cb1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:25.594746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:25.601135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:25.601784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:25.602067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:25.602343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:25.603207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0d5034e89eb64bd6bbc0d02f2da909c1) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:25.603575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:25.605320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf606-319e-4fa7-8cc1-a13d63bcd12c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:25.610977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 595/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:31:25 2022] GET /identity/v3/role_assignments?user.id=0d5034e89eb64bd6bbc0d02f2da909c1&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:31:27.654346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168fe1-2499-47cc-934a-484b420c0a17 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:27.654946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168fe1-2499-47cc-934a-484b420c0a17 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:27.654946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168fe1-2499-47cc-934a-484b420c0a17 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:27.656356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 625/1220] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:27.661738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:27.662152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:27.662337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:27.679187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:27.680415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:27.746163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 596/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:27.769608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168fe1-2499-47cc-934a-484b420c0a17 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:27.870630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168fe1-2499-47cc-934a-484b420c0a17 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:27.903500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:27.904627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:27.904627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:27.904917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:27.914958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:31:27.922718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:27.923846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:27.924916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 626/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:31:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:27.930658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:28.029039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee84de4-2f3a-4be8-9c87-eb619583dfaf None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:28.053863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:28.064251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:28.064922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:28.065207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:28.065482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:28.066253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] RBAC: Adding query filter params (name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:28.066561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:28.067967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:28.076302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 597/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:31:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:28.082484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:28.126756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:28.184632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7322f-a35a-474f-8e1c-0ca0c1c6a367 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:28.218331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:28.219162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:28.219443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:28.219719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:28.230925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:28.232363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:28.250433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:28.253139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:28.254228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:28.254228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:28.254228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:28.254228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:28.254228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 627/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:31:28.257827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:28.356768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244f05-b521-4bba-bd50-4ea43826699d None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:28.390048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:28.390753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:28.391090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:28.391364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:28.392092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:28.392401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:28.393919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:28.405880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 598/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:31:28.411890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:28.507265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:28.513905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abb65f-2d31-41a4-8ca8-df662752ae93 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:28.547849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:28.548646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:28.548932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:28.549207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:28.557387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:28.558871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:31:28.574095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:28.575226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:28.576579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 628/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:28.581385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:28.629372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:28.681867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf4f4-9521-48da-84a9-959bab0fc13f None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:28.716270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:28.717005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:28.717291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:28.717566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:28.718416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:28.718742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:28.720167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:28.737872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 599/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 21 10:31:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:28.743763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:28.846181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99dfc-311a-4fa3-b6ac-8c370386031a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:28.879104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:28.879889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:28.880171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:28.880447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:28.891792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:28.893247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:28.910390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:28.911371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:28.912258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:28.912258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:28.912258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:28.912258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:28.912258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 629/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:28.918593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:29.017241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b493059-2192-4242-b530-108af3bb9863 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:29.019486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:29.052049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:29.052626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:29.052910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:29.053182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:29.054067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:29.054370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:29.055769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:29.066787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 600/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:29.073553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:29.082773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:29.171396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ae01-70c6-4b7d-bbd7-87ce271c57d6 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:29.205690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:29.206479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:29.206781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:29.207055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:29.214166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:29.215629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:31:29.229632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:29.230994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:29.232158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 630/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 10:31:29.236917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:29.336114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bbed7-f130-429d-9cd1-e98bc5148f94 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:29.369975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:29.370630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:29.370945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:29.371218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:29.372002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:29.372307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:29.373719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05432f4-c78c-44f3-96ba-06dc66cffed8 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:29.386828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 601/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:29.393148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:29.458138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:29.491323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9dbfc-8fbc-4f3a-8ab2-1a2ad3019c69 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:29.524225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0ac0-6e24-4dde-9cfa-396d3db879c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:29.525101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0ac0-6e24-4dde-9cfa-396d3db879c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:29.525385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0ac0-6e24-4dde-9cfa-396d3db879c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:29.525664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0ac0-6e24-4dde-9cfa-396d3db879c1 None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0d5034e89eb64bd6bbc0d02f2da909c1/roles/a2a0551b26c54841bfe23dd374f8e800` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:29.539499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0ac0-6e24-4dde-9cfa-396d3db879c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=0d5034e89eb64bd6bbc0d02f2da909c1, role_id=a2a0551b26c54841bfe23dd374f8e800)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:29.540952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0ac0-6e24-4dde-9cfa-396d3db879c1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:29.617141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 631/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:31:29 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0d5034e89eb64bd6bbc0d02f2da909c1/roles/a2a0551b26c54841bfe23dd374f8e800 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:31:31.671373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10d26-fff9-4bcd-bcb6-86c9ea43b70f None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:31.671932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10d26-fff9-4bcd-bcb6-86c9ea43b70f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:31.671932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10d26-fff9-4bcd-bcb6-86c9ea43b70f None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:31.673281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 602/1233] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:31.679220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:31.679720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:31.679867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:31.696387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:31.697631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:31.763740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 632/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:31.787499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10d26-fff9-4bcd-bcb6-86c9ea43b70f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:31.812821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:31.889362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10d26-fff9-4bcd-bcb6-86c9ea43b70f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:31.921925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:31.922652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:31.922954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:31.923226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:31.933617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:31:31.941270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:31.942437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:31.952362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 603/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Jul 21 10:31:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:31.953231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:31.996581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:32.048416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec01ef-cc4c-475d-af82-576d27a0ea8f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:32.080628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:32.081286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:32.081564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:32.081838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:32.082583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:32.082923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:32.084365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:32.094614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 633/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Jul 21 10:31:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:32.098587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:32.184146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:32.199281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a32ce-226f-48f9-862b-d38ec5c0e973 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:32.232319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:32.233158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:32.233594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:32.233870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:32.244395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:32.245828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:32.263589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:32.264704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:32.265808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:32.265808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:32.265808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:32.265808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:32.265808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 604/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:32.271793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:32.371131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69faa9-229b-4788-9092-e2aca7fa2d68 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:32.381008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:32.405924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:32.406667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:32.407094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:32.407209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:32.408212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:32.408212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:32.409916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:32.421840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 634/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:32.427756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:32.528918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb58fb4-fe77-4805-9508-65e08725f4f1 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:32.563081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:32.563972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:32.564258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:32.564535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:32.567192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:32.572011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:32.573440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:31:32.588510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:32.590260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:32.596516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 605/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:32.597247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:32.699749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c161a7-b4cd-4a98-8720-ec96ed7a84f1 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:32.734235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:32.734916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:32.735194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:32.735510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:32.736385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:32.736689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:32.738110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:32.754626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 635/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 21 10:31:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:32.760874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:32.861150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea7728-4cde-4ce0-aa6f-514e0f75780a None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:32.893978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:32.894620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:32.894939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:32.895215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:32.960648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:32.967403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:32.968857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:33.066892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 606/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:31:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:31:33.073353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:33.101663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:33.173762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8483-ddd4-4f9a-8f72-1de1faf029ed None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:33.208064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:33.208849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:33.209132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:33.209409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:33.219470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:33.220946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:33.238792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:33.239845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:33.240977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:33.240977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:33.240977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:33.240977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:33.240977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 636/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:33.246249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:33.338610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:33.344218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a91c2-4f34-4e29-be98-5eafc175caee None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:33.377654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:33.378331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:33.378616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:33.378920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:33.379646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:33.379954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:33.381344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:33.393023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 607/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:33.399022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:33.477178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:33.499051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b05eb-e59c-451f-8ed4-38f69b51a4aa None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:33.533065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:33.533955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:33.534235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:33.534521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:33.541761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:33.543270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:31:33.557342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:33.558416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:33.559585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 637/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:33.564400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:33.663464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951b726-8203-486d-8a3a-078fa1ef85b9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:33.697799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:33.698443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:33.698750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:33.699047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:33.699959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:33.700271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:33.701700 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ec6f8-f675-4a14-b870-5cbcfe2a5561 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:33.714104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 608/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:33.720350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:33.821687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab131-f572-488a-98be-7e4633699e68 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:33.855682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:33.856334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:33.856616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:33.856908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:33.857782 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] RBAC: Adding query filter params (role.id=a2a0551b26c54841bfe23dd374f8e800, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0d5034e89eb64bd6bbc0d02f2da909c1) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:33.858092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:33.859546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb6e8-0315-4076-b5d5-5bb286ced236 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:33.865470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 638/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:31:33 2022] GET /identity/v3/role_assignments?user.id=0d5034e89eb64bd6bbc0d02f2da909c1&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=a2a0551b26c54841bfe23dd374f8e800 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:35.997134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7546f8-5b06-433f-9b46-b8ae25bb073c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:35.997672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7546f8-5b06-433f-9b46-b8ae25bb073c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:35.997794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7546f8-5b06-433f-9b46-b8ae25bb073c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:35.999116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 609/1247] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:36.004291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:36.004681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:36.004845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:36.010597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:36.023316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:36.024599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:36.091813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 639/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:36.115462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7546f8-5b06-433f-9b46-b8ae25bb073c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:36.135286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:36.219547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7546f8-5b06-433f-9b46-b8ae25bb073c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:36.254021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:36.254835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:36.255119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:36.255393 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:36.266170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:31:36.274584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:36.275716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:36.276870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 610/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:31:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:36.281978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:36.383843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72f06-ae72-48b0-9fda-61178235fe44 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:36.412075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:36.417016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:36.417662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:36.417939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:36.418211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:36.418989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:36.419303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:36.420648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:36.429656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 640/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:31:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:36.435367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:36.512829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:36.534978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a82ce-0b64-4048-b019-7b76ceaecf54 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:36.568183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:36.568966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:36.569292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:36.569561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:36.580074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:36.581937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:36.598179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:36.599295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:36.600242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:36.600242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:36.600242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:36.600242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:36.600242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 611/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:36.606160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:36.708823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253fd67-c61f-4d21-9b76-d036436efbaf None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:36.742274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:36.742961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:36.743247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:36.743522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:36.744247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:36.744558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:36.745964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:36.757979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 641/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:36.763672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:36.865169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eec018-957a-46ea-a6a8-df7a3825f805 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:36.891951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:36.899967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:36.900803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:36.901126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:36.901394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:36.908668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:36.910091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:31:36.924727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:36.925884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:36.926869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 612/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:36.932476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:36.989209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:37.034358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d945-7286-427e-be98-a0359a4eaa80 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:37.069668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:37.070389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:37.070675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:37.070978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:37.071819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:37.072128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:37.073538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:37.091753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 642/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 21 10:31:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:37.097798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:37.199053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba424d-fd10-4266-b19a-a9b2d89e96a0 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:37.235305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:37.235957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:37.236242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:37.237269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:37.291707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:37.303710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:37.305221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:37.403112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 613/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:31:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 10:31:37.408981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:37.507954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732055-569b-4b52-9187-22833af59a0c None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:37.520774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:37.542015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:37.542813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:37.543098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:37.543373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:37.553134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:37.554639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:37.572795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:37.576296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:37.577255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:37.577255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:37.577255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:37.577255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:37.577255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 643/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:37.580079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:37.666935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:37.678439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf363-d641-40a0-b85f-1e3ef33bd528 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:37.711956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:37.712617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:37.712899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:37.713175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:37.713906 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:37.714271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:37.716139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:37.728077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 614/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:37.734043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:37.835887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75697e35-7f65-4769-a1f2-b4c974abf690 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:37.869349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:37.870127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:37.870519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:37.870836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:37.877388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:37.878840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:31:37.893192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:37.894269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:37.895342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 644/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:37.900474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:38.000166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577a91-1bcf-4288-99e4-c81cfafd5a8c None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:38.032759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:38.033409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:38.033690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:38.034009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:38.034827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:38.035140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:38.036551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e3dd-40fc-4248-b64b-531955255238 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:38.049481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 615/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:38.056107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:38.080965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:38.153346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca13a-854b-4b08-a0eb-fe5f1ed1a228 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:38.187064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:38.187716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:38.187999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:38.188280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:38.189119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0d5034e89eb64bd6bbc0d02f2da909c1) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:38.189430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:38.190881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfccb5-2761-4225-a1ee-059d7b5cad2e None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:38.196592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 645/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:31:38 2022] GET /identity/v3/role_assignments?user.id=0d5034e89eb64bd6bbc0d02f2da909c1&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:40.245605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb4e30-a1ad-46a0-956f-991649c82644 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:40.246292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb4e30-a1ad-46a0-956f-991649c82644 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:40.246292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb4e30-a1ad-46a0-956f-991649c82644 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:40.247569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 616/1261] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:40.252791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:40.258032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:40.258032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:40.270256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:40.271483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:40.338133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 646/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:40.360952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb4e30-a1ad-46a0-956f-991649c82644 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:40.372140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:40.463568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb4e30-a1ad-46a0-956f-991649c82644 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:40.497938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:40.498661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:40.498979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:40.499256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:40.509955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:31:40.517782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:40.518937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:40.520005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 617/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:40.525638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:40.544259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:40.623566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749661a-6693-46f7-8869-e026a9ee6407 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:40.656498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:40.657209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:40.657512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:40.657785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:40.658528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:40.658867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:40.660234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:40.669057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 647/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:40.675063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:40.741930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:40.775226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5961dc0-019a-4b75-9ba2-2d57cc561ccc None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:40.808797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:40.809613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:40.809896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:40.810171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:40.821797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:40.823587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:40.840037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:40.841102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:40.842220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:40.842220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:40.842220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:40.842220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:40.842220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 618/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:40.847333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:40.926965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:40.946596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cd1f1-4dae-427d-8753-7eec39e1a434 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:40.979297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:40.979965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:40.980250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:40.980527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:40.981510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:40.981820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:40.983256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:40.995755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 648/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:41.001595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:41.103574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4b4ae-87b0-4481-bae7-51df635d0a81 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:41.123699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:41.136915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:41.137761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:41.138043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:41.138317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:41.145452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:41.146906 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:31:41.161224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:41.162455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:41.164241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 619/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:41.168892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:41.267363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163abc9-d776-4ccc-b8f3-7d692e4e34ef None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:41.301108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:41.301769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:41.302048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:41.302318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:41.303204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:41.303509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:41.305807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:41.314094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:41.322554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 649/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 21 10:31:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:41.328238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:41.428000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084579b2-836e-45c8-b982-8f7693e15634 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:41.460481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:41.461397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:41.461676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:41.461945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:41.472195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:41.473617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:41.491446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:41.492501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:41.493596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:41.493596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:41.493596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:41.493596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:41.493596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 620/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:41.498485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:41.597473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154243-0b69-411f-bee2-f55121a4b596 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:41.632130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:41.632791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:41.633076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:41.633355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:41.634116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:41.634422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:41.635820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:41.646866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 650/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:41.653432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:41.686306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:41.753951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fcd5b-91fb-425b-b27a-b8f0532beb7b None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:41.789336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:41.790328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:41.790814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:41.791712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:41.798433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:41.799913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:31:41.814165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:41.815224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:41.816315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 621/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:41.821803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:41.879925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:41.921210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f56e-16f1-45f2-a3ee-f4147832b6bb None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:41.960058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:41.960058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:41.960058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:41.960058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:41.960968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:41.960968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:41.960968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f37e9-eefb-4527-a321-a5b3561a8abc None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:41.972386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 651/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:41.979156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:42.069985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:42.078573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53b84-88bb-4552-8d64-10ec5f9d73df None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:42.112769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbc506-f7de-436e-a81f-74378668f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:42.113651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbc506-f7de-436e-a81f-74378668f32a None admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:42.114024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbc506-f7de-436e-a81f-74378668f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:42.114498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbc506-f7de-436e-a81f-74378668f32a None admin] PATH_INFO: `/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0d5034e89eb64bd6bbc0d02f2da909c1/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:42.117410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbc506-f7de-436e-a81f-74378668f32a None admin] RBAC: Authorizing `identity:create_grant(project_id=c492b68bdd7347c7bf9891000153c799, user_id=0d5034e89eb64bd6bbc0d02f2da909c1, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:42.118866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbc506-f7de-436e-a81f-74378668f32a None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:42.178181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 622/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Jul 21 10:31:41 2022] PUT /identity/v3/projects/c492b68bdd7347c7bf9891000153c799/users/0d5034e89eb64bd6bbc0d02f2da909c1/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:31:44.227910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3829-2f70-448c-be43-659bd7f7eb51 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:44.228473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3829-2f70-448c-be43-659bd7f7eb51 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:44.228551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3829-2f70-448c-be43-659bd7f7eb51 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:44.229870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 652/1274] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:44.235525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:44.240353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:44.240353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:44.253384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:44.254559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:44.321630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 623/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:31:44.344996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb3829-2f70-448c-be43-659bd7f7eb51 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:44.446032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb3829-2f70-448c-be43-659bd7f7eb51 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:44.463353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:44.480363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:44.481358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:44.481641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:44.481918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:44.492159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 10:31:44.499909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:44.500983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:44.501912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 653/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Jul 21 10:31:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:44.507322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:44.586944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:44.604895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5961730-c42b-4caa-9d07-5df4c83d28b5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:44.638770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:44.639439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:44.639725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:44.640001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:44.640756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:44.641065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:44.642425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:44.650932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 624/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Jul 21 10:31:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:44.656872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:44.756692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fb10b-845a-4543-8836-337496e6fb6a None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:44.792431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:44.793227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:44.793515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:44.793793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:44.804480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:44.805919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:44.823360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:44.824434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:44.825571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:44.825571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:44.825571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:44.825571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:44.825571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 654/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:44.830417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:44.929685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ba97-550f-48c2-9f72-e21da1ecb5a6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:44.963757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:44.964417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:44.964698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:44.964970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:44.965693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:44.965994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:44.967369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:44.979390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 625/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:44.985222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:45.016895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:45.086375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41f93d-a9a5-440d-8392-0f8ed09260da None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:45.119873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:45.120655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:45.120934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:45.121206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:45.128515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:45.129940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 10:31:45.144750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:45.145863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:45.147264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 655/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:45.152095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:45.155921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:45.252193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aa160-1c54-4b51-82f3-0f68d1554bae None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:45.285844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:45.286442 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:45.286804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:45.287114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:45.288065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:45.288487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:45.289908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:45.307357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 626/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Jul 21 10:31:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:45.313204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:45.402281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:45.411548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b999-ee4b-4560-b908-5d4609267eaa None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:45.443607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:45.444241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:45.445158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:45.445386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:45.511938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:45.513386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:45.599106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:45.610006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 656/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Jul 21 10:31:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 10:31:45.615955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:45.677290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:45.715391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8349fe-1ab0-4cba-bc75-6e2d6af0a504 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:45.749790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:45.750574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:45.750890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:45.751164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:45.760774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:45.762195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 10:31:45.779490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:45.780451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:45.781439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 10:31:45.781439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 10:31:45.781439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 10:31:45.781439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:45.781439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 627/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:45.786587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:45.883933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a36912-2f10-4ba1-abe1-35e05ef3cd05 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:45.917473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:45.918119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:45.918399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:45.918673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:45.919420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:45.919834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:45.921129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:45.932185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 657/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Jul 21 10:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:31:45.937810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:46.035030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4aa1a-0922-451c-b7e1-87eedb6dd9e6 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:46.049547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:46.068860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:46.069655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:46.070009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:46.070324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:46.076981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:46.078401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 10:31:46.093407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:46.094480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: ERROR keystone.server.flask.application Jul 21 10:31:46.095589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 628/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Jul 21 10:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:46.100592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:46.150875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:46.199786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fa13-6d13-4908-bae3-cd05a0849ee2 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:46.233541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:46.234188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:46.234467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:46.234766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:46.235544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:46.235848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:46.237265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22308984-0155-4a50-9592-e8b8e3fe547c None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:46.250568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 658/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Jul 21 10:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:46.256795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:46.354698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cd771-bdf4-4157-ac31-502d702a58c9 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:46.388995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:46.389644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:46.389926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:46.390199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:46.391057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] RBAC: Adding query filter params (role.id=5378a78ce3ee497fa1b16a7c4a71bc29, scope.project.id=c492b68bdd7347c7bf9891000153c799, user.id=0d5034e89eb64bd6bbc0d02f2da909c1) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:46.391368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:46.392832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d9a07-a62b-4a68-b44b-1b89805a41a9 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:46.398962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 629/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Jul 21 10:31:46 2022] GET /identity/v3/role_assignments?user.id=0d5034e89eb64bd6bbc0d02f2da909c1&scope.project.id=c492b68bdd7347c7bf9891000153c799&role.id=5378a78ce3ee497fa1b16a7c4a71bc29 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:48.503927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fcb7a-20f8-4484-b48a-cb2bf457bc1c None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:48.504451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fcb7a-20f8-4484-b48a-cb2bf457bc1c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:48.504568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fcb7a-20f8-4484-b48a-cb2bf457bc1c None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:48.505898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 659/1288] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:48.511643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608c6e-5d01-4483-9436-a58501994168 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:48.512026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608c6e-5d01-4483-9436-a58501994168 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:48.512197 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608c6e-5d01-4483-9436-a58501994168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:48.529516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-27608c6e-5d01-4483-9436-a58501994168 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:48.531708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-27608c6e-5d01-4483-9436-a58501994168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:48.559438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:48.597230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 630/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:48.620020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fcb7a-20f8-4484-b48a-cb2bf457bc1c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:48.723141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fcb7a-20f8-4484-b48a-cb2bf457bc1c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:48.734584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:48.758721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:48.759477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:48.759764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:48.760042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:48.760698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:48.762069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:48.774537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:48.775736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:48.776601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 660/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:31:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:48.781957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608c6e-5d01-4483-9436-a58501994168 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:48.879329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608c6e-5d01-4483-9436-a58501994168 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:48.913444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:48.914304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:48.914654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:48.914956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:48.915664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:48.915966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:48.917371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cecf83-1037-4130-b2bb-8ea46a634561 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:48.922559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 631/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 21 10:31:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:48.928136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:49.028990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a1242-3605-4d23-881e-add870a6ab96 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:49.061800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:49.062454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:49.062765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:49.063046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] PATH_INFO: `/v3/services` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:49.063756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:49.064079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:49.065417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dcd35-70ee-4950-9348-74f617e8081f None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:49.070400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 661/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 21 10:31:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:51.108313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314055-83c2-4fb0-817d-bfbaa3c8dcbc None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:51.108856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314055-83c2-4fb0-817d-bfbaa3c8dcbc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:51.108955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314055-83c2-4fb0-817d-bfbaa3c8dcbc None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:51.110263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 632/1293] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:51.115488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793434-123d-414d-b771-1b7d14386eb1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:51.115890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793434-123d-414d-b771-1b7d14386eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:51.117919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793434-123d-414d-b771-1b7d14386eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:51.133819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3b793434-123d-414d-b771-1b7d14386eb1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:51.135060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3b793434-123d-414d-b771-1b7d14386eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:51.164004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:51.202815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 662/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 10:31:51.226308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314055-83c2-4fb0-817d-bfbaa3c8dcbc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:51.257870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:51.325817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314055-83c2-4fb0-817d-bfbaa3c8dcbc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:51.360839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c50426-1c1f-43fd-926f-cdf68a34ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:51.361408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50426-1c1f-43fd-926f-cdf68a34ecf1 None admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:51.361686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50426-1c1f-43fd-926f-cdf68a34ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:51.361958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50426-1c1f-43fd-926f-cdf68a34ecf1 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:51.362670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c50426-1c1f-43fd-926f-cdf68a34ecf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:51.364046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c50426-1c1f-43fd-926f-cdf68a34ecf1 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:51.475787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 633/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Jul 21 10:31:51 2022] POST /identity/v3/services => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:31:53.560513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227115f-1acc-4dee-985e-7d6bb6d818d0 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:53.561154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227115f-1acc-4dee-985e-7d6bb6d818d0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:53.561154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227115f-1acc-4dee-985e-7d6bb6d818d0 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:53.562658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 663/1296] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:53.568000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:53.568421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:53.568673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:53.586046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:53.587284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:53.658817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 634/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:53.682743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227115f-1acc-4dee-985e-7d6bb6d818d0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:53.783351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227115f-1acc-4dee-985e-7d6bb6d818d0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:53.816620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:53.817408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:53.817687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:53.817959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:53.818612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:53.820694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:53.832601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:53.833711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:53.834843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 664/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:31:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:53.840666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:53.858837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:53.936992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8070d19-02e5-4801-b657-a55943a3407b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:53.971252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:53.971910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:53.972242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:53.972522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:53.973231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:53.973537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:53.974918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:53.980275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 635/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 21 10:31:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:53.986263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:54.017870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:54.086600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed51976-e4a6-42b7-adfe-23904d84e618 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:54.119675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:54.120326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:54.120642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:54.120915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:54.121821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] RBAC: Adding query filter params (interface=public, service_id=04955111e92643f892e40274c70befca, region_id=RegionOne) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:54.122132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:54.123564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e51396-fab0-428d-9324-e458832d67ed None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:54.128567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 665/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Jul 21 10:31:53 2022] GET /identity/v3/endpoints?service_id=04955111e92643f892e40274c70befca&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:54.135120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:54.216578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:54.235237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb44e3d-5639-4a73-bc9d-201e6c2d3128 None admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:54.270191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15a23-a060-4472-b53c-9d6ea194c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:54.270889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15a23-a060-4472-b53c-9d6ea194c109 None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:54.271179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15a23-a060-4472-b53c-9d6ea194c109 None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:54.271458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15a23-a060-4472-b53c-9d6ea194c109 None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:54.272149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15a23-a060-4472-b53c-9d6ea194c109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:54.273678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15a23-a060-4472-b53c-9d6ea194c109 None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:54.280651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 636/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Jul 21 10:31:54 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:31:56.325590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a302b8-0fd9-436f-a1b1-b3360d36e172 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:56.326177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a302b8-0fd9-436f-a1b1-b3360d36e172 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:56.326177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a302b8-0fd9-436f-a1b1-b3360d36e172 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:56.327544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 666/1302] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:31:56.332701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:56.333115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:56.333261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:56.349982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:31:56.351940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:31:56.420529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 637/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:31:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 10:31:56.443904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a302b8-0fd9-436f-a1b1-b3360d36e172 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:56.541115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:56.547594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a302b8-0fd9-436f-a1b1-b3360d36e172 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:56.581911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:56.582627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:56.582937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:56.583226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:56.583879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:56.585224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 10:31:56.597181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 10:31:56.598382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application with Lock( Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self._enter() Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application return self.creator() Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application created_value = creator( Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: ERROR keystone.server.flask.application Jul 21 10:31:56.611118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 667/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Jul 21 10:31:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 10:31:56.612121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:56.681207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:31:56.703826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18aa2f-f2be-4ad6-83d7-65fa0eab6d74 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:56.737798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:56.742469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:56.742469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:56.742469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] PATH_INFO: `/v3/services` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:56.742469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:31:56.742469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:56.742469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7379138-0b33-428c-bd23-49e81bcf82ee None admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:56.747212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 638/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Jul 21 10:31:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:31:56.752997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:31:56.850667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ce7cf-76d4-4ca9-92a6-af1da6cfd990 None admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:31:56.884584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534adcf3-50b8-4c8c-8ec4-aa3f662a9523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:31:56.885234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534adcf3-50b8-4c8c-8ec4-aa3f662a9523 None admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:31:56.885513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534adcf3-50b8-4c8c-8ec4-aa3f662a9523 None admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:31:56.885783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534adcf3-50b8-4c8c-8ec4-aa3f662a9523 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:31:56.886581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534adcf3-50b8-4c8c-8ec4-aa3f662a9523 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:31:56.887970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534adcf3-50b8-4c8c-8ec4-aa3f662a9523 None admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:31:56.967226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 668/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Jul 21 10:31:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:32:06.744159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=30 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:32:06.962703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:36.805489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4278c0-71dc-4ced-8bbe-0f045368b9c4 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:36.806550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4278c0-71dc-4ced-8bbe-0f045368b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:36.806981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4278c0-71dc-4ced-8bbe-0f045368b9c4 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:36.808745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 639/1307] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:36.813922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c4ce-0c9d-4a4f-89f9-06c88b0b4c89 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:36.819827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c4ce-0c9d-4a4f-89f9-06c88b0b4c89 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:36.819827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c4ce-0c9d-4a4f-89f9-06c88b0b4c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:36.894532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9569c4ce-0c9d-4a4f-89f9-06c88b0b4c89 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:36.895862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9569c4ce-0c9d-4a4f-89f9-06c88b0b4c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:37.031317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 669/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:37.145976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb453-84aa-4c75-8da2-ae3125a92cc4 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:37.146471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb453-84aa-4c75-8da2-ae3125a92cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:37.146844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb453-84aa-4c75-8da2-ae3125a92cc4 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:37.148492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 640/1309] 10.222.0.49 () {54 vars in 965 bytes} [Thu Jul 21 10:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:37.155277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b3afa-f1d9-4831-a638-e72e62e94e57 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:37.155586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b3afa-f1d9-4831-a638-e72e62e94e57 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:37.155835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b3afa-f1d9-4831-a638-e72e62e94e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:37.279856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b66b3afa-f1d9-4831-a638-e72e62e94e57 None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:37.281036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b66b3afa-f1d9-4831-a638-e72e62e94e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:37.304871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:37.372269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 670/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Thu Jul 21 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:37:37.386877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bb453-84aa-4c75-8da2-ae3125a92cc4 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:37.386877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e28bb453-84aa-4c75-8da2-ae3125a92cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:37.559248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bb453-84aa-4c75-8da2-ae3125a92cc4 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:37.665695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:37.666396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:37.666675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:37.667877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:37.669773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:37.744926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:37.813720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:37.815950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cabf9-eac8-4729-93f9-f0dbc0771714 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:37.837475 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 641/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:40.231767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ace12-db1a-42c0-afae-c99a8385662e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:40.232413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ace12-db1a-42c0-afae-c99a8385662e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:40.232413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ace12-db1a-42c0-afae-c99a8385662e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:40.233754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 671/1312] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:40.239240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b23ed-4c35-4124-badf-125b8ba0341a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:40.239684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b23ed-4c35-4124-badf-125b8ba0341a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:40.239809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b23ed-4c35-4124-badf-125b8ba0341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:40.322683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1d6b23ed-4c35-4124-badf-125b8ba0341a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:40.324044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1d6b23ed-4c35-4124-badf-125b8ba0341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:40.426665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 642/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:40.466004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ace12-db1a-42c0-afae-c99a8385662e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:40.467630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-282ace12-db1a-42c0-afae-c99a8385662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:40.574092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ace12-db1a-42c0-afae-c99a8385662e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:40.656887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:40.659233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:40.659904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:40.660186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:40.660463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:40.663011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:40.778156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:40.781317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5803a6-0c87-4c1e-91fa-b3f8f94fd323 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:40.802293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 672/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:43.304486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6bd8-d661-44af-9df0-a8538696e682 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:43.305054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6bd8-d661-44af-9df0-a8538696e682 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:43.305054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6bd8-d661-44af-9df0-a8538696e682 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:43.306421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 643/1315] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:43.311517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4390e-29ff-48a1-bf50-ae4bcf7659aa None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:43.311951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4390e-29ff-48a1-bf50-ae4bcf7659aa None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:43.312083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4390e-29ff-48a1-bf50-ae4bcf7659aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:43.376523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ced4390e-29ff-48a1-bf50-ae4bcf7659aa None None] MFA Rules not processed for user `de229b1cc5474a4893e26902c78ad7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:43.377739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ced4390e-29ff-48a1-bf50-ae4bcf7659aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:43.429785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:43.474182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 673/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:43.514335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6bd8-d661-44af-9df0-a8538696e682 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:43.515925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-549a6bd8-d661-44af-9df0-a8538696e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:43.526877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:43.621463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6bd8-d661-44af-9df0-a8538696e682 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:43.693898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:43.694548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:43.694871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:43.695145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:43.696793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:43.757647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:43.805078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:43.806550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d30a-2e4c-4f9c-964c-9dfe537c367b service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:43.824718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 644/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:46.685614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019fb50-5a43-4468-b23a-3301a75004b9 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:46.686155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019fb50-5a43-4468-b23a-3301a75004b9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:46.686155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019fb50-5a43-4468-b23a-3301a75004b9 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:46.687578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 674/1318] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:37:46.693401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adca45-ed89-463f-84d3-b7129f223dac None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:46.693802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adca45-ed89-463f-84d3-b7129f223dac None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:46.693959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adca45-ed89-463f-84d3-b7129f223dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:46.758456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-91adca45-ed89-463f-84d3-b7129f223dac None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:46.759706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-91adca45-ed89-463f-84d3-b7129f223dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:46.855273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 645/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:46.895027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019fb50-5a43-4468-b23a-3301a75004b9 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:46.897091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b019fb50-5a43-4468-b23a-3301a75004b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:47.000025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019fb50-5a43-4468-b23a-3301a75004b9 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:47.071431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:47.072078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:47.072359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:47.072631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:47.074276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:47.081505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:47.181781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:47.183254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f725d-d083-4b59-950e-24c8fd82f1a1 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:47.200871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 675/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:50.264790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf2c0-ce37-42d0-9bce-06ca8131011b None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:50.265353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf2c0-ce37-42d0-9bce-06ca8131011b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:50.265353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf2c0-ce37-42d0-9bce-06ca8131011b None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:50.266934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 646/1321] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:50.272456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d1a7-de21-47a0-a140-1c103e65b77d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:50.272855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d1a7-de21-47a0-a140-1c103e65b77d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:50.273027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d1a7-de21-47a0-a140-1c103e65b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:50.340026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-13f6d1a7-de21-47a0-a140-1c103e65b77d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:50.341245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-13f6d1a7-de21-47a0-a140-1c103e65b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:50.400645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:50.443619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 676/1322] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:37:50.495595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fe8cc-fa24-4b05-8f13-c7a87c94b0b2 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:50.495885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fe8cc-fa24-4b05-8f13-c7a87c94b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:50.496166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fe8cc-fa24-4b05-8f13-c7a87c94b0b2 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:50.497577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 647/1323] 10.222.0.49 () {54 vars in 965 bytes} [Thu Jul 21 10:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:50.504248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908ffe3-1732-4200-9aca-3fc30a1fad8c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:50.504694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908ffe3-1732-4200-9aca-3fc30a1fad8c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:50.505050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908ffe3-1732-4200-9aca-3fc30a1fad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:50.587574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a908ffe3-1732-4200-9aca-3fc30a1fad8c None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:50.588836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a908ffe3-1732-4200-9aca-3fc30a1fad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:50.672450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 677/1324] 10.222.0.49 () {58 vars in 1062 bytes} [Thu Jul 21 10:37:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:50.681715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fe8cc-fa24-4b05-8f13-c7a87c94b0b2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:50.683274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5d5fe8cc-fa24-4b05-8f13-c7a87c94b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:50.702471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:50.789786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fe8cc-fa24-4b05-8f13-c7a87c94b0b2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:50.862222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:50.862888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:50.863172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:50.863464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:50.865287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:50.935293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:50.973248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:50.974839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7bef6-ef41-4df4-a7c2-1fa6bc1dbf5b service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:50.994168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 648/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:53.310454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540f9-d9be-40da-990b-20118521a47f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:53.310989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540f9-d9be-40da-990b-20118521a47f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:53.311181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540f9-d9be-40da-990b-20118521a47f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:53.312667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 678/1326] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:53.318157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408156-b834-473e-99b2-badffa7a7130 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:53.318593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408156-b834-473e-99b2-badffa7a7130 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:53.318746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408156-b834-473e-99b2-badffa7a7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:53.389691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-81408156-b834-473e-99b2-badffa7a7130 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:53.391033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-81408156-b834-473e-99b2-badffa7a7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:53.494570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 649/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:53.531520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540f9-d9be-40da-990b-20118521a47f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:53.533125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a97540f9-d9be-40da-990b-20118521a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:53.603927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:53.648046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540f9-d9be-40da-990b-20118521a47f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:53.722464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:53.723219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:53.723573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:53.723866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:53.725530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:53.834856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:53.837277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:53.838808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05d4c-a81e-40bd-856f-eb84a46f2e43 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:53.857149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 679/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:55.965067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b278-1b3b-4ec9-a79b-5705445168e3 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:55.965576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b278-1b3b-4ec9-a79b-5705445168e3 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:55.965576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b278-1b3b-4ec9-a79b-5705445168e3 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:55.966927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 650/1329] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:55.972442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448829-876b-43b9-9c11-81a2bf576dc4 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:55.973391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448829-876b-43b9-9c11-81a2bf576dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:55.973534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448829-876b-43b9-9c11-81a2bf576dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:56.040427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4b448829-876b-43b9-9c11-81a2bf576dc4 None None] MFA Rules not processed for user `de229b1cc5474a4893e26902c78ad7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:56.041646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4b448829-876b-43b9-9c11-81a2bf576dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:56.138533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 680/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:56.177356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b278-1b3b-4ec9-a79b-5705445168e3 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:56.178951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c8a7b278-1b3b-4ec9-a79b-5705445168e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:56.218099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:56.295833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b278-1b3b-4ec9-a79b-5705445168e3 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:56.369479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:56.370124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:56.370404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:56.370674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:56.372371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:56.449430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:56.480979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:56.482349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a45865-c773-43c4-86a8-47b0be536c54 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:56.501328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 651/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:37:58.970095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0b7bc-846c-4104-aa59-992c1ab9d9ad None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:58.970767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0b7bc-846c-4104-aa59-992c1ab9d9ad None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:58.970767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0b7bc-846c-4104-aa59-992c1ab9d9ad None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:58.972051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 681/1332] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:37:58.977946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77275900-d184-45bd-a76d-e754eea1a06e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:58.978352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77275900-d184-45bd-a76d-e754eea1a06e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:58.978505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77275900-d184-45bd-a76d-e754eea1a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:59.046827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-77275900-d184-45bd-a76d-e754eea1a06e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:37:59.047990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-77275900-d184-45bd-a76d-e754eea1a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:59.153946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 652/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:37:59.190149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0b7bc-846c-4104-aa59-992c1ab9d9ad None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:37:59.192302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-96f0b7bc-846c-4104-aa59-992c1ab9d9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:59.269162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:59.305375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0b7bc-846c-4104-aa59-992c1ab9d9ad None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:37:59.385074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:37:59.385722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:37:59.386003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:37:59.386275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:37:59.387930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:37:59.495781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:37:59.497210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869b7f5-d691-4688-987e-9e5ebc43ada2 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:37:59.507684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:37:59.515587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 682/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:01.573669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527bcaa-3eaa-4e8a-9686-ce3df98eb3ac None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:01.574310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527bcaa-3eaa-4e8a-9686-ce3df98eb3ac None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:01.574310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527bcaa-3eaa-4e8a-9686-ce3df98eb3ac None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:01.575692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 653/1335] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:01.580890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b87b1-988b-43ec-8c86-5d71454dbcac None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:01.581270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b87b1-988b-43ec-8c86-5d71454dbcac None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:01.581437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b87b1-988b-43ec-8c86-5d71454dbcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:01.649438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-255b87b1-988b-43ec-8c86-5d71454dbcac None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:01.650674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-255b87b1-988b-43ec-8c86-5d71454dbcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:01.746958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 683/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:01.787471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527bcaa-3eaa-4e8a-9686-ce3df98eb3ac None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:01.789044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0527bcaa-3eaa-4e8a-9686-ce3df98eb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:01.829353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:01.899693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527bcaa-3eaa-4e8a-9686-ce3df98eb3ac None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:01.981780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:01.982485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:01.982822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:01.983130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:01.984862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:02.069557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:02.094395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:02.095792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78e7d4-2261-462f-b55b-1236afc30439 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:02.114971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 654/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:04.754970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d381-789b-4106-83a7-2f35d436ab37 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:04.755548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d381-789b-4106-83a7-2f35d436ab37 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:04.755548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d381-789b-4106-83a7-2f35d436ab37 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:04.756924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 684/1338] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:04.762171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764968f-4ca4-4451-9569-fd0c5b775fc4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:04.762567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764968f-4ca4-4451-9569-fd0c5b775fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:04.762753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764968f-4ca4-4451-9569-fd0c5b775fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:04.827150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f764968f-4ca4-4451-9569-fd0c5b775fc4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:04.828351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f764968f-4ca4-4451-9569-fd0c5b775fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:04.923714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 655/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:04.961284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d381-789b-4106-83a7-2f35d436ab37 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:04.962844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-53b8d381-789b-4106-83a7-2f35d436ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:05.036965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:05.064437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d381-789b-4106-83a7-2f35d436ab37 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:05.140374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:05.141012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:05.141290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:05.141561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:05.143246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:05.251755 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:05.253175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90b1cb-0746-49ea-b6b3-5f2b06827752 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:05.273763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 685/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:09.473668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b0504-5aef-4008-823c-c24cb2b3c471 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:09.474138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b0504-5aef-4008-823c-c24cb2b3c471 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:09.474356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b0504-5aef-4008-823c-c24cb2b3c471 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:09.475675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 656/1341] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:09.481491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5bace-0f04-4e39-86e8-4addb69fba22 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:09.481941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5bace-0f04-4e39-86e8-4addb69fba22 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:09.482084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5bace-0f04-4e39-86e8-4addb69fba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:09.486246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:09.557990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d8a5bace-0f04-4e39-86e8-4addb69fba22 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:09.559244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d8a5bace-0f04-4e39-86e8-4addb69fba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:09.662571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 686/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:09.702493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b0504-5aef-4008-823c-c24cb2b3c471 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:09.704149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-455b0504-5aef-4008-823c-c24cb2b3c471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:09.754816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:09.811305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b0504-5aef-4008-823c-c24cb2b3c471 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:09.884450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:09.885113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:09.885399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:09.885675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:09.887353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:09.981766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:09.997838 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:09.999330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c1780-cee7-4225-abf1-ad4be3d2ca6b service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:10.017684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 657/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:13.003461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9bcf8-efb5-42b3-aa66-92a44e7ae192 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:13.004558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9bcf8-efb5-42b3-aa66-92a44e7ae192 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:13.004697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9bcf8-efb5-42b3-aa66-92a44e7ae192 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:13.006276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 687/1344] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:13.011584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986335-410f-432e-8639-c42329cb0434 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:13.012019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986335-410f-432e-8639-c42329cb0434 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:13.012284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986335-410f-432e-8639-c42329cb0434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:13.079625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a1986335-410f-432e-8639-c42329cb0434 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:13.080855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a1986335-410f-432e-8639-c42329cb0434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:13.177968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 658/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:13.216498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9bcf8-efb5-42b3-aa66-92a44e7ae192 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:13.218045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d8b9bcf8-efb5-42b3-aa66-92a44e7ae192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:13.306429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:13.323000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9bcf8-efb5-42b3-aa66-92a44e7ae192 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:13.398444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:13.399044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:13.399331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:13.399609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:13.401275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:13.518383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:13.519932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae54f2-aaab-4c25-bccb-9e8fee69b198 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:13.539377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 688/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:17.785791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f986d-cd01-4c0d-bac2-da80f731459f None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:17.786888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f986d-cd01-4c0d-bac2-da80f731459f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:17.786888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f986d-cd01-4c0d-bac2-da80f731459f None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:17.787746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 659/1347] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:17.793156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246f94-c37e-4765-9407-dfe4aef690d9 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:17.793599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246f94-c37e-4765-9407-dfe4aef690d9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:17.793694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246f94-c37e-4765-9407-dfe4aef690d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:17.808787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:17.864419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9a246f94-c37e-4765-9407-dfe4aef690d9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:17.865574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9a246f94-c37e-4765-9407-dfe4aef690d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:17.968581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 689/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:18.008050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f986d-cd01-4c0d-bac2-da80f731459f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:18.009588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-579f986d-cd01-4c0d-bac2-da80f731459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:18.071934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:18.122885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f986d-cd01-4c0d-bac2-da80f731459f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:18.197700 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:18.198361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:18.198646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:18.198972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:18.200643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:18.310939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:18.314524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:18.315978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58167a9-be86-4056-a5b1-6a12c18b08c6 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:18.335636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 660/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:23.281068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19947efc-48f3-4204-a00d-394cd2db0f0f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:23.281531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19947efc-48f3-4204-a00d-394cd2db0f0f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:23.281617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19947efc-48f3-4204-a00d-394cd2db0f0f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:23.283826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 690/1350] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:23.289364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7dd1-01c7-4793-a9d7-188c6228293f None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:23.289802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7dd1-01c7-4793-a9d7-188c6228293f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:23.289990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7dd1-01c7-4793-a9d7-188c6228293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:23.374924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9b7e7dd1-01c7-4793-a9d7-188c6228293f None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:23.376187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9b7e7dd1-01c7-4793-a9d7-188c6228293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:23.531493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 661/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:27.709019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61451c59-e6f8-405f-bfc2-04161674f126 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:27.709906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61451c59-e6f8-405f-bfc2-04161674f126 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:27.710187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61451c59-e6f8-405f-bfc2-04161674f126 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:27.711624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 691/1352] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:38:27.716812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae902ee-2f30-4e09-8dba-feec7e640015 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:27.717634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae902ee-2f30-4e09-8dba-feec7e640015 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:27.718129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae902ee-2f30-4e09-8dba-feec7e640015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:27.790614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:27.817221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-eae902ee-2f30-4e09-8dba-feec7e640015 None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:27.818629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eae902ee-2f30-4e09-8dba-feec7e640015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:27.937535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 662/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:27.966711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=59 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:29.278770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f2771-063a-44d6-8d2d-0f5a3901a8e3 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:29.279402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f2771-063a-44d6-8d2d-0f5a3901a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:29.279402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f2771-063a-44d6-8d2d-0f5a3901a8e3 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:29.280943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 692/1354] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:29.286442 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9ce3-b8eb-444f-a4ed-d17d490152b4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:29.286924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9ce3-b8eb-444f-a4ed-d17d490152b4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:29.287021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9ce3-b8eb-444f-a4ed-d17d490152b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:29.364285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-050a9ce3-b8eb-444f-a4ed-d17d490152b4 None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:29.365496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-050a9ce3-b8eb-444f-a4ed-d17d490152b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:29.409680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:29.475161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 663/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:32.954157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5365d-25a2-456f-8cfc-9a418a556e75 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:32.955332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5365d-25a2-456f-8cfc-9a418a556e75 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:32.955615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5365d-25a2-456f-8cfc-9a418a556e75 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:32.957678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 693/1356] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:32.963957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fabb2-af55-4d38-bdc2-c6510cb83c74 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:32.964431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fabb2-af55-4d38-bdc2-c6510cb83c74 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:32.964739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fabb2-af55-4d38-bdc2-c6510cb83c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:33.049913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ea3fabb2-af55-4d38-bdc2-c6510cb83c74 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:33.051597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ea3fabb2-af55-4d38-bdc2-c6510cb83c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:33.154212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 664/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:38:33.213239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6702-ddb3-4fa2-a48f-34faa99fd5dd None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:33.214475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6702-ddb3-4fa2-a48f-34faa99fd5dd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:33.215764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6702-ddb3-4fa2-a48f-34faa99fd5dd None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:33.219421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 694/1358] 10.222.0.49 () {54 vars in 962 bytes} [Thu Jul 21 10:38:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:33.228582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ffa9e-7b69-486a-ab5d-031ba7e4d759 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:33.228874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ffa9e-7b69-486a-ab5d-031ba7e4d759 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:33.229156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ffa9e-7b69-486a-ab5d-031ba7e4d759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:33.244889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:33.310793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-767ffa9e-7b69-486a-ab5d-031ba7e4d759 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:33.311898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-767ffa9e-7b69-486a-ab5d-031ba7e4d759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:33.441830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 665/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Jul 21 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:38:33.450270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6702-ddb3-4fa2-a48f-34faa99fd5dd None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:33.451828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-65ad6702-ddb3-4fa2-a48f-34faa99fd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:33.627726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6702-ddb3-4fa2-a48f-34faa99fd5dd None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:33.711124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:33.757956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:33.758914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:33.759400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:33.759822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:33.761620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:33.865548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:33.867186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935df224-8936-4509-adb7-efdf9333ff71 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:33.888506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 695/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:38:36.153619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3c01-8fe7-477c-a7c4-cb023d2b0d2b None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:36.154138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3c01-8fe7-477c-a7c4-cb023d2b0d2b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:36.154138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3c01-8fe7-477c-a7c4-cb023d2b0d2b None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:36.156743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 666/1361] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:36.161051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ad00-5843-442e-8900-7591810b379e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:36.161515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ad00-5843-442e-8900-7591810b379e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:36.167791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ad00-5843-442e-8900-7591810b379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:36.230608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2b13ad00-5843-442e-8900-7591810b379e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:36.231948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2b13ad00-5843-442e-8900-7591810b379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:36.274434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:36.346657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 696/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:36.393013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3c01-8fe7-477c-a7c4-cb023d2b0d2b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:36.396441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-bb5c3c01-8fe7-477c-a7c4-cb023d2b0d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:36.469926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:36.556814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3c01-8fe7-477c-a7c4-cb023d2b0d2b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:36.692271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:36.693236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:36.693236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:36.693603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:36.695170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:36.722296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:36.796796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:36.798777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe1fe-b5f5-47de-927f-6493c61172b5 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:36.820304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 667/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:39.365965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905eeb-6deb-4371-8f1b-85d53b90673a None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:39.369875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905eeb-6deb-4371-8f1b-85d53b90673a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:39.369875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905eeb-6deb-4371-8f1b-85d53b90673a None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:39.370850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 697/1364] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:39.375860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358af35-71e0-4dbf-ac3f-287286131372 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:39.376363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358af35-71e0-4dbf-ac3f-287286131372 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:39.376447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358af35-71e0-4dbf-ac3f-287286131372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:39.448123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3358af35-71e0-4dbf-ac3f-287286131372 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:39.449327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3358af35-71e0-4dbf-ac3f-287286131372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:39.559115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:39.562658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 668/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:39.611259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9ddb-ba3d-48a2-900f-47e9eb439a30 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:39.611628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9ddb-ba3d-48a2-900f-47e9eb439a30 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:39.611977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9ddb-ba3d-48a2-900f-47e9eb439a30 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:39.614367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 698/1366] 10.222.0.49 () {54 vars in 962 bytes} [Thu Jul 21 10:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:39.619269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874fc1-c983-4a16-ad3d-eaec367434fa None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:39.619771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874fc1-c983-4a16-ad3d-eaec367434fa None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:39.620238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874fc1-c983-4a16-ad3d-eaec367434fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:39.711761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-71874fc1-c983-4a16-ad3d-eaec367434fa None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:39.713922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-71874fc1-c983-4a16-ad3d-eaec367434fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:39.847537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 669/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Jul 21 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:39.855989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9ddb-ba3d-48a2-900f-47e9eb439a30 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:39.857511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-dbde9ddb-ba3d-48a2-900f-47e9eb439a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:40.013649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9ddb-ba3d-48a2-900f-47e9eb439a30 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:40.034551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:40.134062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:40.134749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:40.135046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:40.135321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:40.136983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:40.233850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:40.235530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66da30-03a2-4830-8c1e-702a4b62c6d3 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:40.255182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 699/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:41.281348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef2b8-9668-4c94-9ea6-5b31f349ffb9 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.281917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef2b8-9668-4c94-9ea6-5b31f349ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.281917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef2b8-9668-4c94-9ea6-5b31f349ffb9 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.283457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 670/1369] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:41.289163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f69d5-45fb-4b6a-b24e-3d205a38e2ba None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.289697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f69d5-45fb-4b6a-b24e-3d205a38e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.289980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f69d5-45fb-4b6a-b24e-3d205a38e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.322852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:41.360346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-684f69d5-45fb-4b6a-b24e-3d205a38e2ba None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:41.361589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-684f69d5-45fb-4b6a-b24e-3d205a38e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.467067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 700/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:41.820230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c54a-85d0-4142-94d2-120d11cbcd1e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.820230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c54a-85d0-4142-94d2-120d11cbcd1e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.820230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c54a-85d0-4142-94d2-120d11cbcd1e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.821943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 671/1371] 10.222.0.49 () {54 vars in 964 bytes} [Thu Jul 21 10:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:41.826509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083373-c207-4c68-a9e7-f2b5a9f23114 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:41.826953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083373-c207-4c68-a9e7-f2b5a9f23114 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:41.827118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083373-c207-4c68-a9e7-f2b5a9f23114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:41.907561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-60083373-c207-4c68-a9e7-f2b5a9f23114 None None] MFA Rules not processed for user `992d129919be4586b6e1c9d1fed498b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:41.908785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-60083373-c207-4c68-a9e7-f2b5a9f23114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:41.958553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:41.991209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 701/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Thu Jul 21 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:41.998951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4c54a-85d0-4142-94d2-120d11cbcd1e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:42.000477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2ca4c54a-85d0-4142-94d2-120d11cbcd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:42.053457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:42.111909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4c54a-85d0-4142-94d2-120d11cbcd1e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:42.188035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:42.188702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:42.188985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:42.189273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:42.190961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:42.294784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:42.308867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:42.310354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20dd6f-32b7-4363-ad27-4be6c032793d service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:42.330897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 672/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:42.522134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a875e5-245a-4a54-8e4f-f786e7f47eff None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:42.522579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a875e5-245a-4a54-8e4f-f786e7f47eff None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:42.522812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a875e5-245a-4a54-8e4f-f786e7f47eff None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:42.524207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 702/1374] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:38:42.529503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480e925-1154-4614-bcb3-7a6d1e052eca None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:42.529901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480e925-1154-4614-bcb3-7a6d1e052eca None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:42.530062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480e925-1154-4614-bcb3-7a6d1e052eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:42.609465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3480e925-1154-4614-bcb3-7a6d1e052eca None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:42.610844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3480e925-1154-4614-bcb3-7a6d1e052eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:42.731245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 673/1375] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:42.771589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a875e5-245a-4a54-8e4f-f786e7f47eff None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:42.777633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-28a875e5-245a-4a54-8e4f-f786e7f47eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:42.938166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a875e5-245a-4a54-8e4f-f786e7f47eff None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:42.992786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:43.057362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:43.058012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:43.058296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:43.058571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:43.060297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:43.152247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:43.153880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61217-50ff-4d8f-bea0-aaf4ae05bf7c service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:43.172943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 703/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:45.364539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4064ec8-5a29-430d-a949-319d7e4c03a3 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:45.365072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4064ec8-5a29-430d-a949-319d7e4c03a3 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:45.365072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4064ec8-5a29-430d-a949-319d7e4c03a3 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:45.366679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 674/1377] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:45.372050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd154af-0903-45d3-9a83-1bb054d9118c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:45.372485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd154af-0903-45d3-9a83-1bb054d9118c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:45.372603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd154af-0903-45d3-9a83-1bb054d9118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:45.449404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7fd154af-0903-45d3-9a83-1bb054d9118c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:45.450623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7fd154af-0903-45d3-9a83-1bb054d9118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:45.462123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:45.566025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 704/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:45.610308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4064ec8-5a29-430d-a949-319d7e4c03a3 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:45.611869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f4064ec8-5a29-430d-a949-319d7e4c03a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:45.672889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:45.763997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4064ec8-5a29-430d-a949-319d7e4c03a3 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:45.916690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:45.917367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:45.917652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:45.917927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:45.919833 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:45.944221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:46.042051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:46.045862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7a90-738e-4a9e-8aaf-6eb2478c3ba3 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:46.068219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 675/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:48.296819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a708-02e6-4eb7-bf49-fbba1d3ec1b6 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:48.297368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a708-02e6-4eb7-bf49-fbba1d3ec1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:48.297368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a708-02e6-4eb7-bf49-fbba1d3ec1b6 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:48.303025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 705/1380] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:48.304659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e086-21b1-461b-88bd-45cd4d701934 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:48.305196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e086-21b1-461b-88bd-45cd4d701934 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:48.305196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e086-21b1-461b-88bd-45cd4d701934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:48.377491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4221e086-21b1-461b-88bd-45cd4d701934 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:48.378739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4221e086-21b1-461b-88bd-45cd4d701934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:48.485117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:48.492512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 676/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:48.537872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a708-02e6-4eb7-bf49-fbba1d3ec1b6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:48.539678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7be7a708-02e6-4eb7-bf49-fbba1d3ec1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:48.694070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:48.705119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a708-02e6-4eb7-bf49-fbba1d3ec1b6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:48.855615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:48.856502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:48.856790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:48.857127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:48.858948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:48.955541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:48.957799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca3131-af42-4e39-935f-9c687675920b service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:48.968926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:48.978733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 706/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:51.223791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d002d-611b-4352-8586-f19abd2fc2fb None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:51.224575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d002d-611b-4352-8586-f19abd2fc2fb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:51.224575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d002d-611b-4352-8586-f19abd2fc2fb None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:51.225821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 677/1383] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:51.231623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9235f-0084-4c1d-9bbd-3cc48ff8625a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:51.232254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9235f-0084-4c1d-9bbd-3cc48ff8625a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:51.232254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9235f-0084-4c1d-9bbd-3cc48ff8625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:51.299960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f5f9235f-0084-4c1d-9bbd-3cc48ff8625a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:51.301343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f5f9235f-0084-4c1d-9bbd-3cc48ff8625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:51.400414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 707/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:38:51.444969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d002d-611b-4352-8586-f19abd2fc2fb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:51.446651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5a9d002d-611b-4352-8586-f19abd2fc2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:51.598360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d002d-611b-4352-8586-f19abd2fc2fb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:51.670429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:51.727117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:51.728100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:51.728421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:51.728745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:51.730601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:51.826490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:51.828141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdae9b-6241-49dd-9963-4db5e1c0b1ce service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:51.848351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 678/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:53.906564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ce325-a401-4b04-8564-a5a3b175f04a None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:53.907123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ce325-a401-4b04-8564-a5a3b175f04a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:53.907259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ce325-a401-4b04-8564-a5a3b175f04a None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:53.908551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 708/1386] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:38:53.915000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5db1a-a014-4549-9e3a-d6a111d34b07 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:53.915445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5db1a-a014-4549-9e3a-d6a111d34b07 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:53.915566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5db1a-a014-4549-9e3a-d6a111d34b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:53.985579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c3a5db1a-a014-4549-9e3a-d6a111d34b07 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:53.986853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c3a5db1a-a014-4549-9e3a-d6a111d34b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:54.022549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:54.090067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 679/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:54.135013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ce325-a401-4b04-8564-a5a3b175f04a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:54.136639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b39ce325-a401-4b04-8564-a5a3b175f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:54.218710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:54.308479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ce325-a401-4b04-8564-a5a3b175f04a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:54.453705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:54.454277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:54.454568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:54.454872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:54.456532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:54.496237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:54.553402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:54.555060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7eb02-698d-4042-b722-e1b1238da4ac service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:54.573709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 709/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:56.769789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350d00-5d06-4d4c-85fc-d6063c5f0a7d None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:56.770328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350d00-5d06-4d4c-85fc-d6063c5f0a7d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:56.770328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350d00-5d06-4d4c-85fc-d6063c5f0a7d None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:56.771861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 680/1389] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:56.777299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aadbc1-b02a-4fbb-b1ed-b7639367bf74 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:56.777746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aadbc1-b02a-4fbb-b1ed-b7639367bf74 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:56.777842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aadbc1-b02a-4fbb-b1ed-b7639367bf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:56.843330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-71aadbc1-b02a-4fbb-b1ed-b7639367bf74 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:56.844538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-71aadbc1-b02a-4fbb-b1ed-b7639367bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:56.942159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 710/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:56.986919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7350d00-5d06-4d4c-85fc-d6063c5f0a7d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:56.988454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a7350d00-5d06-4d4c-85fc-d6063c5f0a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:57.134443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7350d00-5d06-4d4c-85fc-d6063c5f0a7d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:57.151755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:57.251664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:57.252323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:57.252609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:57.252888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:57.254560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:57.344016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:57.345754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5912712-88ee-422a-ab02-43312159c407 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:57.364762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 681/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:58.108428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04348-341f-4e70-aec0-d32d257f9fd0 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.109016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04348-341f-4e70-aec0-d32d257f9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.109016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04348-341f-4e70-aec0-d32d257f9fd0 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.110348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 711/1392] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:58.116428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d391b8-952a-4be3-8810-182ba8d11b10 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.116879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d391b8-952a-4be3-8810-182ba8d11b10 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.116994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d391b8-952a-4be3-8810-182ba8d11b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.142321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:58.184142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f5d391b8-952a-4be3-8810-182ba8d11b10 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:58.185425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f5d391b8-952a-4be3-8810-182ba8d11b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:58.283524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 682/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:58.341716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648dad-d23c-4f7b-a8e9-8f4e9cadcef1 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.342043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648dad-d23c-4f7b-a8e9-8f4e9cadcef1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.342324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648dad-d23c-4f7b-a8e9-8f4e9cadcef1 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.344063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 712/1394] 10.222.0.49 () {54 vars in 966 bytes} [Thu Jul 21 10:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:58.349329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe7abd-46c2-476d-9794-13af3f513545 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.349620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe7abd-46c2-476d-9794-13af3f513545 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.349984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe7abd-46c2-476d-9794-13af3f513545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.425920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3fbe7abd-46c2-476d-9794-13af3f513545 None None] MFA Rules not processed for user `a7d5722330cc432ea6b3c4f505a78669`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:58.427758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3fbe7abd-46c2-476d-9794-13af3f513545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:58.469534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:58.507990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 683/1395] 10.222.0.49 () {58 vars in 1063 bytes} [Thu Jul 21 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:58.515649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648dad-d23c-4f7b-a8e9-8f4e9cadcef1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:58.517157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bd648dad-d23c-4f7b-a8e9-8f4e9cadcef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:58.531651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:58.624730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648dad-d23c-4f7b-a8e9-8f4e9cadcef1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:58.698830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:38:58.699400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:58.699684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:58.699958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:58.701601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:58.772793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:58.815535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:38:58.816966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cf97c-269b-4e19-9270-4d632e3d5d76 service glance] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:38:58.835396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 713/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:38:59.564231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39233f25-d3cb-4a2c-b9eb-32161c3dce5d None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:59.564733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39233f25-d3cb-4a2c-b9eb-32161c3dce5d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:59.564835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39233f25-d3cb-4a2c-b9eb-32161c3dce5d None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:59.568544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 684/1397] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:38:59.572145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:59.572611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:59.572694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:59.641517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:59.643069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:59.719242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5334a2-135b-41e3-b900-51a0a17418b9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:59.719686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5334a2-135b-41e3-b900-51a0a17418b9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:59.720026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5334a2-135b-41e3-b900-51a0a17418b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:59.783054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 714/1398] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:38:59.798443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9a5334a2-135b-41e3-b900-51a0a17418b9 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:38:59.799865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9a5334a2-135b-41e3-b900-51a0a17418b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:59.813356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:38:59.814822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:38:59.844787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:59.900363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 685/1399] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:38:59.942321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbddd7b-5165-413f-ac1d-ba83ab034361 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:38:59.950565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4c40-e171-49d5-961f-6236211c09ff None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:59.951358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4c40-e171-49d5-961f-6236211c09ff None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:59.951646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4c40-e171-49d5-961f-6236211c09ff None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:38:59.953631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 686/1400] 10.222.0.49 () {54 vars in 943 bytes} [Thu Jul 21 10:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:38:59.967542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:38:59.967907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:38:59.968257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:00.038417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:00.045794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] MFA Rules not processed for user `24ea97317d564485a0982fe7533561be`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:00.047111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:00.061069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:00.061723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:00.062002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:00.062277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:00.063940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:00.082975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:00.158249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 687/1401] 10.222.0.49 () {58 vars in 1040 bytes} [Thu Jul 21 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:39:00.159070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:00.160693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fdc6c-420f-40f0-b031-a3e943eeffcb service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:00.168200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:00.177577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898ad8-d989-45ef-b7de-d6769c77d9d9 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:00.180722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 715/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:39:00.285910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:00.287243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:00.287531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:00.287807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:00.289578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:00.292241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:00.376636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:00.378286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdaa7f-fe68-4708-a769-b9f8b632e44d service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:00.388600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 688/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:39:02.364060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359579-29f6-46b3-8fbd-76721394c9b3 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:02.365136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359579-29f6-46b3-8fbd-76721394c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:02.365136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359579-29f6-46b3-8fbd-76721394c9b3 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:02.371002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 716/1404] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:39:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:02.372468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5405c0-5a44-43bc-b24b-724459fdbada None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:02.372894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5405c0-5a44-43bc-b24b-724459fdbada None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:02.373036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5405c0-5a44-43bc-b24b-724459fdbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:02.449704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-bf5405c0-5a44-43bc-b24b-724459fdbada None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:02.450886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-bf5405c0-5a44-43bc-b24b-724459fdbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:02.557537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:02.563957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 689/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:02.609651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9359579-29f6-46b3-8fbd-76721394c9b3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:02.611261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c9359579-29f6-46b3-8fbd-76721394c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:02.787222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:02.794243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9359579-29f6-46b3-8fbd-76721394c9b3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:02.922983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:02.923908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:02.924358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:02.924636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:02.926303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:03.033757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:03.035483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ad8c0-d543-4995-80ad-23f5824e27ad service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:03.063094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 717/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:05.345730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c43e9-32b5-4def-812f-2e06af1cdd1a None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:05.346365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c43e9-32b5-4def-812f-2e06af1cdd1a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:05.346365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c43e9-32b5-4def-812f-2e06af1cdd1a None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:05.348209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 690/1407] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:05.353457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa5413-455f-40ad-b953-879810cb8260 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:05.353887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa5413-455f-40ad-b953-879810cb8260 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:05.354034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa5413-455f-40ad-b953-879810cb8260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:05.357391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:05.429658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bbfa5413-455f-40ad-b953-879810cb8260 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:05.431110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bbfa5413-455f-40ad-b953-879810cb8260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:05.544366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 718/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:05.590082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c43e9-32b5-4def-812f-2e06af1cdd1a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:05.591655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ce9c43e9-32b5-4def-812f-2e06af1cdd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:05.760278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c43e9-32b5-4def-812f-2e06af1cdd1a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:05.844921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:05.897497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:05.898154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:05.898428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:05.898722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:05.901041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:06.005562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:06.007210 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebfa4-eff8-48c6-8c21-2be2ca7281d6 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:06.026591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 691/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:15.542632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=64 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:16.024089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=64 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:23.762114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d914-221d-4baa-b478-24082c1e083c None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:23.762656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d914-221d-4baa-b478-24082c1e083c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:23.762656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d914-221d-4baa-b478-24082c1e083c None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:23.764155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 719/1410] 10.222.0.49 () {54 vars in 918 bytes} [Thu Jul 21 10:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:39:23.769209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dc5bd-38e5-4095-bfff-2b7fa605b21d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:23.769619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dc5bd-38e5-4095-bfff-2b7fa605b21d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:23.769764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dc5bd-38e5-4095-bfff-2b7fa605b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:23.846072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f27dc5bd-38e5-4095-bfff-2b7fa605b21d None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:23.847322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f27dc5bd-38e5-4095-bfff-2b7fa605b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:23.953148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 692/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 21 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:23.967170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e20d0-7f18-4f44-82d7-69aa5fd4fe4c None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:23.967459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e20d0-7f18-4f44-82d7-69aa5fd4fe4c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:23.967734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e20d0-7f18-4f44-82d7-69aa5fd4fe4c None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:23.969136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 720/1412] 10.222.0.49 () {54 vars in 918 bytes} [Thu Jul 21 10:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:23.973645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005645-3880-4080-b635-0a91b705273e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:23.974613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005645-3880-4080-b635-0a91b705273e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:23.975113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005645-3880-4080-b635-0a91b705273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:24.048062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:24.050655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-41005645-3880-4080-b635-0a91b705273e None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:24.051924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-41005645-3880-4080-b635-0a91b705273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:24.166574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 693/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 21 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:26.672509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2a08-b5b1-449c-9818-27d7681dd2c7 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:26.673072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2a08-b5b1-449c-9818-27d7681dd2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:26.673072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2a08-b5b1-449c-9818-27d7681dd2c7 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:26.674445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:26.680349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a13c-c5cf-449f-a2c4-000e340ddd7e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:26.680789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a13c-c5cf-449f-a2c4-000e340ddd7e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:26.680899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a13c-c5cf-449f-a2c4-000e340ddd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:26.747864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c9c0a13c-c5cf-449f-a2c4-000e340ddd7e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:26.749083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c9c0a13c-c5cf-449f-a2c4-000e340ddd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:26.803542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:26.844423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:26.888056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2a08-b5b1-449c-9818-27d7681dd2c7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:26.889626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6ade2a08-b5b1-449c-9818-27d7681dd2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:27.035916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2a08-b5b1-449c-9818-27d7681dd2c7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:27.108222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:27.148186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:27.148828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:27.149111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:27.149382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:27.151064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:27.239083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:27.240751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec3a50-20f7-45ee-8f5d-692a299042a7 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:27.258470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 722/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:28.163572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c60a5b-5eef-4977-be95-2c409edc88f2 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:28.164146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c60a5b-5eef-4977-be95-2c409edc88f2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:28.164146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c60a5b-5eef-4977-be95-2c409edc88f2 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:28.165513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:28.170484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6a61-31ff-4e3e-8f32-44703555bcff None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:28.170958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6a61-31ff-4e3e-8f32-44703555bcff None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:28.171077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6a61-31ff-4e3e-8f32-44703555bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:28.245204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-87ef6a61-31ff-4e3e-8f32-44703555bcff None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:28.246418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-87ef6a61-31ff-4e3e-8f32-44703555bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:28.274004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:28.342990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:28.493692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c60a5b-5eef-4977-be95-2c409edc88f2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:28.495167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-99c60a5b-5eef-4977-be95-2c409edc88f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:28.640516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c60a5b-5eef-4977-be95-2c409edc88f2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:28.680385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:28.754529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:28.755761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:28.756048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:28.756324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:28.757987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:28.845494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:28.847125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035698-040d-4988-bf3c-74c383106203 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:28.865652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 696/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:29.748923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec946-a38e-44d2-9ba1-8fc10ef267fb None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:29.749493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec946-a38e-44d2-9ba1-8fc10ef267fb None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:29.749493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec946-a38e-44d2-9ba1-8fc10ef267fb None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:29.751000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:29.756465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9227a3f-3d8a-4324-813f-0c83b4851232 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:29.756874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9227a3f-3d8a-4324-813f-0c83b4851232 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:29.757013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9227a3f-3d8a-4324-813f-0c83b4851232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:29.810358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:29.832390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b9227a3f-3d8a-4324-813f-0c83b4851232 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:29.835036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b9227a3f-3d8a-4324-813f-0c83b4851232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:29.933128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:30.088705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec946-a38e-44d2-9ba1-8fc10ef267fb None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:30.090092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-795ec946-a38e-44d2-9ba1-8fc10ef267fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:30.236769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec946-a38e-44d2-9ba1-8fc10ef267fb None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:30.249320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:30.349211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:30.349775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:30.350058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:30.350335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:30.352019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:30.441020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:30.442672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e095e-650d-4171-8ae8-bc9c14908c79 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:30.461885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 725/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:31.325761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f4971-c691-496f-9dab-44674f77361e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:31.326296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f4971-c691-496f-9dab-44674f77361e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:31.326434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f4971-c691-496f-9dab-44674f77361e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:31.327741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:31.332698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80703-af4f-437b-b400-f38f271dfe05 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:31.333748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80703-af4f-437b-b400-f38f271dfe05 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:31.333873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80703-af4f-437b-b400-f38f271dfe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:31.351917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:31.409239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d3a80703-af4f-437b-b400-f38f271dfe05 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:31.410453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d3a80703-af4f-437b-b400-f38f271dfe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:31.507436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:31.656152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f4971-c691-496f-9dab-44674f77361e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:31.657582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b75f4971-c691-496f-9dab-44674f77361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:31.766172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:31.803268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f4971-c691-496f-9dab-44674f77361e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:31.919463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:31.920041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:31.920331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:31.920612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:31.922283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:31.998266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:32.011440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:32.013034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d836e9-76cb-432f-aa07-4b1bfb46f2e5 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:32.031935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 699/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:32.901013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7cde1-1171-48bf-8c4a-132e4b551eca None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:32.901539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7cde1-1171-48bf-8c4a-132e4b551eca None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:32.901661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7cde1-1171-48bf-8c4a-132e4b551eca None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:32.902990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:32.907964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c25a0-d9bd-46ce-be33-95f92c52a9d5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:32.908340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c25a0-d9bd-46ce-be33-95f92c52a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:32.908523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c25a0-d9bd-46ce-be33-95f92c52a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:32.981852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b98c25a0-d9bd-46ce-be33-95f92c52a9d5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:32.983087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b98c25a0-d9bd-46ce-be33-95f92c52a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:33.078526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:33.227502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7cde1-1171-48bf-8c4a-132e4b551eca None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:33.229297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d3f7cde1-1171-48bf-8c4a-132e4b551eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:33.312798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:33.372889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7cde1-1171-48bf-8c4a-132e4b551eca None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:33.484065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:33.484718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:33.485000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:33.485270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:33.486932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:33.533978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:33.575707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:33.577278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c0983-cbd0-4487-adc6-d79fe9de9066 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:33.596794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 728/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:34.475865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34334ac6-e09a-456e-b683-61baa5427b19 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:34.476463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34334ac6-e09a-456e-b683-61baa5427b19 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:34.476463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34334ac6-e09a-456e-b683-61baa5427b19 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:34.477800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:39:34.483033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06eff-8abd-4b97-9489-b3819fcdcf8d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:34.483415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06eff-8abd-4b97-9489-b3819fcdcf8d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:34.483586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06eff-8abd-4b97-9489-b3819fcdcf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:34.558195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-87f06eff-8abd-4b97-9489-b3819fcdcf8d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:34.559436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-87f06eff-8abd-4b97-9489-b3819fcdcf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:34.656144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:34.809004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34334ac6-e09a-456e-b683-61baa5427b19 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:34.810528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-34334ac6-e09a-456e-b683-61baa5427b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:34.859238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:34.958096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34334ac6-e09a-456e-b683-61baa5427b19 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:35.073888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:35.074533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:35.074857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:35.075129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:35.076780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:35.084172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:35.165975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:35.167605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e928a-5df7-466f-94a4-273041705cf2 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:35.185812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 702/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:36.046336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a826ebc-d552-43c6-824b-86224cf3c5cf None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:36.046965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a826ebc-d552-43c6-824b-86224cf3c5cf None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:36.046965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a826ebc-d552-43c6-824b-86224cf3c5cf None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:36.048319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:36.054007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b60a-0ec3-4354-b70f-9fd37b73ab90 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:36.054437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b60a-0ec3-4354-b70f-9fd37b73ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:36.054542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b60a-0ec3-4354-b70f-9fd37b73ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:36.128468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2a02b60a-0ec3-4354-b70f-9fd37b73ab90 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:36.129683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2a02b60a-0ec3-4354-b70f-9fd37b73ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:36.196492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:36.224589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:36.376196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a826ebc-d552-43c6-824b-86224cf3c5cf None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:36.377722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1a826ebc-d552-43c6-824b-86224cf3c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:36.396298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:36.524567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a826ebc-d552-43c6-824b-86224cf3c5cf None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:36.610857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:36.636344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:36.636936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:36.637224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:36.637540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:36.639227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:36.729676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:36.731319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70436c09-41e7-4e2a-9639-97b4d0ab0ccc service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:36.749744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 731/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:37.639431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce983-e8ff-418c-aa95-10f28002aba8 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:37.639999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce983-e8ff-418c-aa95-10f28002aba8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:37.639999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce983-e8ff-418c-aa95-10f28002aba8 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:37.641438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:37.653374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b06b-063a-441c-97e3-f968c4325165 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:37.653874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b06b-063a-441c-97e3-f968c4325165 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:37.653973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b06b-063a-441c-97e3-f968c4325165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:37.736649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f788b06b-063a-441c-97e3-f968c4325165 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:37.737772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f788b06b-063a-441c-97e3-f968c4325165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:37.786444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:37.843642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:38.015090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce983-e8ff-418c-aa95-10f28002aba8 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:38.016566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c2fce983-e8ff-418c-aa95-10f28002aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:38.203468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce983-e8ff-418c-aa95-10f28002aba8 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:38.261891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:38.336730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:38.337398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:38.337682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:38.337960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:38.339847 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:38.435457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:38.437054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f78cc-8ddc-416a-b1aa-981f795b17ef service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:38.454812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 705/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:39.320011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a00cd-af9f-4c55-aea9-a145da40127a None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:39.320648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a00cd-af9f-4c55-aea9-a145da40127a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:39.320648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a00cd-af9f-4c55-aea9-a145da40127a None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:39.322019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:39:39.326884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e980fd-e3fc-41f7-b2c9-a368a0abd036 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:39.327322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e980fd-e3fc-41f7-b2c9-a368a0abd036 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:39.327482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e980fd-e3fc-41f7-b2c9-a368a0abd036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:39.402835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-83e980fd-e3fc-41f7-b2c9-a368a0abd036 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:39.404053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-83e980fd-e3fc-41f7-b2c9-a368a0abd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:39.406053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:39.501259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:39.650258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a00cd-af9f-4c55-aea9-a145da40127a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:39.651746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3f8a00cd-af9f-4c55-aea9-a145da40127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:39.798633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a00cd-af9f-4c55-aea9-a145da40127a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:39.824882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:39.910960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:39.912168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:39.912446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:39.912717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:39.914374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:40.002061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:40.003718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e723c27-bb29-437e-af9c-2b7cecc99e26 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:40.021798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 734/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:41.964085 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cb5da-c063-4a2e-a81e-e2e798e9e6a5 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:41.964649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cb5da-c063-4a2e-a81e-e2e798e9e6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:41.964649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cb5da-c063-4a2e-a81e-e2e798e9e6a5 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:41.966060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:41.971365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef10d86-e4d7-467d-904d-8370e68c59d2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:41.971793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef10d86-e4d7-467d-904d-8370e68c59d2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:41.971922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef10d86-e4d7-467d-904d-8370e68c59d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:42.011871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:42.075392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fef10d86-e4d7-467d-904d-8370e68c59d2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:42.075392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fef10d86-e4d7-467d-904d-8370e68c59d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:42.132932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:42.172798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cb5da-c063-4a2e-a81e-e2e798e9e6a5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:42.174341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b71cb5da-c063-4a2e-a81e-e2e798e9e6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:42.277287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cb5da-c063-4a2e-a81e-e2e798e9e6a5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:42.309065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:42.350747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:42.351324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:42.351610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:42.351888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:42.353819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:42.462751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:42.464195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa24bc-9a41-4ada-9b1d-5f980cdb7bcf service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:42.482961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 708/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:44.675453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a3ac-03af-44ca-923a-91588a320b61 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:44.676024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a3ac-03af-44ca-923a-91588a320b61 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:44.676024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a3ac-03af-44ca-923a-91588a320b61 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:44.678209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:44.683460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9243-7f76-46dd-9ecc-224e6264fe7d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:44.683886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9243-7f76-46dd-9ecc-224e6264fe7d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:44.684006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9243-7f76-46dd-9ecc-224e6264fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:44.748099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f23f9243-7f76-46dd-9ecc-224e6264fe7d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:44.749309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f23f9243-7f76-46dd-9ecc-224e6264fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:44.761921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:44.845571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:44.886338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a3ac-03af-44ca-923a-91588a320b61 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:44.899231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d606a3ac-03af-44ca-923a-91588a320b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:44.992943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a3ac-03af-44ca-923a-91588a320b61 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:45.004790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:45.065596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:45.066443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:45.066760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:45.067041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:45.068748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:45.178794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:45.180235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0a9a-7845-4120-bff3-ac8507e240f2 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:45.198087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 737/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:47.597779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c24f5e-364a-4ce1-823c-aee04fed1e59 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:47.598345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c24f5e-364a-4ce1-823c-aee04fed1e59 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:47.598345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c24f5e-364a-4ce1-823c-aee04fed1e59 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:47.599967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:47.605419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e675d-42f3-48b5-9754-12cf3d5ff820 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:47.605845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e675d-42f3-48b5-9754-12cf3d5ff820 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:47.605990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e675d-42f3-48b5-9754-12cf3d5ff820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:47.653760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:47.671935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-165e675d-42f3-48b5-9754-12cf3d5ff820 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:47.673198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-165e675d-42f3-48b5-9754-12cf3d5ff820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:47.769708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:47.808734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c24f5e-364a-4ce1-823c-aee04fed1e59 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:47.810290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-15c24f5e-364a-4ce1-823c-aee04fed1e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:47.914003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c24f5e-364a-4ce1-823c-aee04fed1e59 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:47.955640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:47.991234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:47.992003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:47.992485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:47.992931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:47.994901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:48.105731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:48.107200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50af5c-9817-4f65-a076-8ab9a67cf878 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:48.125447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 711/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:50.308421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40365ee-7e3f-447a-956b-2db59046d35e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:50.308984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40365ee-7e3f-447a-956b-2db59046d35e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:50.308984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40365ee-7e3f-447a-956b-2db59046d35e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:50.310349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:50.315552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4514a-7ede-4537-bd78-b324729886d9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:50.316004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4514a-7ede-4537-bd78-b324729886d9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:50.316100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4514a-7ede-4537-bd78-b324729886d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:50.380093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f4e4514a-7ede-4537-bd78-b324729886d9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:50.382019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f4e4514a-7ede-4537-bd78-b324729886d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:50.402270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:50.477538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:50.517052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40365ee-7e3f-447a-956b-2db59046d35e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:50.518626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c40365ee-7e3f-447a-956b-2db59046d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:50.621338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40365ee-7e3f-447a-956b-2db59046d35e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:50.641391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:50.695369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:50.696012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:50.696298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:50.696564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:50.698209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:50.807774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:50.809218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a3e3d-05b3-41de-a017-c10bebf2e6c4 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:50.827079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 740/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:52.923643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5d16-9f97-4996-9447-7130a874c57f None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:52.924198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5d16-9f97-4996-9447-7130a874c57f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:52.924198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5d16-9f97-4996-9447-7130a874c57f None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:52.925633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:52.931305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14b93-9799-4702-a624-9724e2e68e60 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:52.931774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14b93-9799-4702-a624-9724e2e68e60 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:52.931997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14b93-9799-4702-a624-9724e2e68e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:52.994657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:52.997477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4fd14b93-9799-4702-a624-9724e2e68e60 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:52.998679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4fd14b93-9799-4702-a624-9724e2e68e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:53.096052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:53.136681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5d16-9f97-4996-9447-7130a874c57f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:53.138211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a0ae5d16-9f97-4996-9447-7130a874c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:53.240672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5d16-9f97-4996-9447-7130a874c57f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:53.288352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:53.312852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:53.313503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:53.313779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:53.314049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:53.315705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:53.422587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:53.424046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f772a27-63ca-4b27-bf72-73d06ceca982 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:53.444264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 714/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:55.628669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4e15-328f-4de9-b793-febe51706d4f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:55.629235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4e15-328f-4de9-b793-febe51706d4f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:55.629235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4e15-328f-4de9-b793-febe51706d4f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:55.631368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:55.636678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5047e-2a04-494a-a669-a03c964c9a9f None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:55.637094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5047e-2a04-494a-a669-a03c964c9a9f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:55.637232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5047e-2a04-494a-a669-a03c964c9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:55.701682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-74a5047e-2a04-494a-a669-a03c964c9a9f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:55.702910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-74a5047e-2a04-494a-a669-a03c964c9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:55.731346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:55.798386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:55.837260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4e15-328f-4de9-b793-febe51706d4f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:55.838885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2f4f4e15-328f-4de9-b793-febe51706d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:55.942968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4e15-328f-4de9-b793-febe51706d4f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:55.970851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:56.017684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:56.018328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:56.018609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:56.018910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:56.020551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:56.130716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:56.132175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24bb49-aa62-43c1-b5f9-c8cb9c78619d service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:56.150322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 743/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:58.238637 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669b43-76f9-411d-b6bf-5b7c574c2b3b None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:58.239204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669b43-76f9-411d-b6bf-5b7c574c2b3b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:58.239204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669b43-76f9-411d-b6bf-5b7c574c2b3b None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:58.241239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:39:58.246488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3390-c123-44b0-8cea-18cb60dddba2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:58.246976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3390-c123-44b0-8cea-18cb60dddba2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:58.247126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3390-c123-44b0-8cea-18cb60dddba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:58.310764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1e0c3390-c123-44b0-8cea-18cb60dddba2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:39:58.311966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1e0c3390-c123-44b0-8cea-18cb60dddba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:58.320074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:58.407839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:39:58.446707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669b43-76f9-411d-b6bf-5b7c574c2b3b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:39:58.448250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0f669b43-76f9-411d-b6bf-5b7c574c2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:58.552858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669b43-76f9-411d-b6bf-5b7c574c2b3b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:39:58.608322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:39:58.626105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:39:58.626776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:39:58.627061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:39:58.627344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:39:58.628990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:39:58.738245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:39:58.739719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b01ca-15b8-434c-b4fe-00e9581c367e service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:39:58.758225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 717/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:00.850905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092d68-4c57-4433-b758-c701f7bb8ad0 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:00.851450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092d68-4c57-4433-b758-c701f7bb8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:00.851450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092d68-4c57-4433-b758-c701f7bb8ad0 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:00.852862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:40:00.858418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f4db-47d4-447b-b4cb-58f95ff20b74 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:00.858866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f4db-47d4-447b-b4cb-58f95ff20b74 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:00.859004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f4db-47d4-447b-b4cb-58f95ff20b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:01.042173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7c21f4db-47d4-447b-b4cb-58f95ff20b74 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:01.043339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7c21f4db-47d4-447b-b4cb-58f95ff20b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:01.081547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:01.138794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:01.176069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092d68-4c57-4433-b758-c701f7bb8ad0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:01.178260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-06092d68-4c57-4433-b758-c701f7bb8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:01.281531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092d68-4c57-4433-b758-c701f7bb8ad0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:01.319514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:01.355158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:01.355806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:01.356094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:01.356371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:01.358016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:01.465073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:01.466511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49917-e3c5-4599-91b4-51abdbfa2ea3 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:01.486742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 746/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:03.559725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fce21-e83a-4b94-917c-9d01a0c0a810 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:03.560167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fce21-e83a-4b94-917c-9d01a0c0a810 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:03.560296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fce21-e83a-4b94-917c-9d01a0c0a810 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:03.561678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:03.567118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3bde-442d-4257-b1b3-15fd53058ce7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:03.567536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3bde-442d-4257-b1b3-15fd53058ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:03.567661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3bde-442d-4257-b1b3-15fd53058ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:03.634677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-88da3bde-442d-4257-b1b3-15fd53058ce7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:03.635925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-88da3bde-442d-4257-b1b3-15fd53058ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:03.654378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:03.733809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:03.772189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fce21-e83a-4b94-917c-9d01a0c0a810 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:03.773718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-785fce21-e83a-4b94-917c-9d01a0c0a810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:03.878738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fce21-e83a-4b94-917c-9d01a0c0a810 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:03.944371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:03.950976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:03.951635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:03.951915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:03.952168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:03.953803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:04.061236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:04.062680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf03317-d601-4a54-9295-6cac18a5941a service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:04.081025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 720/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:06.121607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14bf0-045f-4bcb-9390-a06aa2e62cd2 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:06.122162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14bf0-045f-4bcb-9390-a06aa2e62cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:06.122162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14bf0-045f-4bcb-9390-a06aa2e62cd2 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:06.123585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:40:06.128770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c72221-df5c-4ad3-bb25-7ea73710ca1c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:06.129181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c72221-df5c-4ad3-bb25-7ea73710ca1c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:06.129328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c72221-df5c-4ad3-bb25-7ea73710ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:06.193955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-18c72221-df5c-4ad3-bb25-7ea73710ca1c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:06.195232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-18c72221-df5c-4ad3-bb25-7ea73710ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:06.243487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:06.291742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:06.329591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14bf0-045f-4bcb-9390-a06aa2e62cd2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:06.331166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5ad14bf0-045f-4bcb-9390-a06aa2e62cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:06.438297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14bf0-045f-4bcb-9390-a06aa2e62cd2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:06.485942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:06.511890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:06.512536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:06.512819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:06.513093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:06.514773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:06.621329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:06.622710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe294c-7eb4-407f-b514-2742645e63e8 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:06.641356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 749/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:16.289895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=22 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:16.639024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=66 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:26.454494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67fad-353c-493e-bcc5-a6471cc8594a None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:26.455108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67fad-353c-493e-bcc5-a6471cc8594a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:26.455108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67fad-353c-493e-bcc5-a6471cc8594a None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:26.456502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 722/1471] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:26.461869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838e598-332f-404c-a288-1083a33e265d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:26.462318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838e598-332f-404c-a288-1083a33e265d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:26.462423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838e598-332f-404c-a288-1083a33e265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:26.527286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2838e598-332f-404c-a288-1083a33e265d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:26.528508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2838e598-332f-404c-a288-1083a33e265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:26.624147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 750/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:26.707723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19e18-92fb-4db1-8484-ad1fb5e5062f None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:26.707958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19e18-92fb-4db1-8484-ad1fb5e5062f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:26.708236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19e18-92fb-4db1-8484-ad1fb5e5062f None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:26.709625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 723/1473] 10.222.0.49 () {54 vars in 966 bytes} [Thu Jul 21 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:26.714471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e053-c13c-41f1-9bae-5a80ad0d6fbc None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:26.714816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e053-c13c-41f1-9bae-5a80ad0d6fbc None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:26.715095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e053-c13c-41f1-9bae-5a80ad0d6fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:26.790660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2ec9e053-c13c-41f1-9bae-5a80ad0d6fbc None None] MFA Rules not processed for user `a7d5722330cc432ea6b3c4f505a78669`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:26.791890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2ec9e053-c13c-41f1-9bae-5a80ad0d6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:26.812083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:26.867726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 751/1474] 10.222.0.49 () {58 vars in 1063 bytes} [Thu Jul 21 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:26.875338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19e18-92fb-4db1-8484-ad1fb5e5062f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:26.876881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-69f19e18-92fb-4db1-8484-ad1fb5e5062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:26.979853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19e18-92fb-4db1-8484-ad1fb5e5062f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:27.051226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:27.051872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:27.052160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:27.052980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:27.054729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:27.108450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:27.163610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:27.165066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cf018-2d37-4a2c-9369-bc0c63400aac service glance] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:27.185257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 724/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:29.304153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc589b9-9a92-4927-a9af-c67505ec3279 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:29.304704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc589b9-9a92-4927-a9af-c67505ec3279 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:29.304855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc589b9-9a92-4927-a9af-c67505ec3279 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:29.306182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 752/1476] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:29.311548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0d1f-3706-4fe5-a617-748e896be162 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:29.311972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0d1f-3706-4fe5-a617-748e896be162 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:29.312105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0d1f-3706-4fe5-a617-748e896be162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:29.378660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-fccd0d1f-3706-4fe5-a617-748e896be162 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:29.379831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fccd0d1f-3706-4fe5-a617-748e896be162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:29.477633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 725/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:29.500971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc589b9-9a92-4927-a9af-c67505ec3279 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:29.502494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-abc589b9-9a92-4927-a9af-c67505ec3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:29.625709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc589b9-9a92-4927-a9af-c67505ec3279 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:29.673663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:29.719579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:29.720239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:29.720520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:29.720789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:29.721522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:29.723305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:40:29.723305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:40:29.723305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:40:29.724494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439bdc3-d070-40d2-a1c9-adeb7c5f55e8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:29.743316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 753/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Jul 21 10:40:29 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:40:31.820575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651b4a-2087-4577-9048-cef4f1a5cb1c None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:31.821087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651b4a-2087-4577-9048-cef4f1a5cb1c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:31.821193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651b4a-2087-4577-9048-cef4f1a5cb1c None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:31.822522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 726/1479] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:31.827811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0673-0471-48e8-883f-34ebff381251 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:31.828212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0673-0471-48e8-883f-34ebff381251 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:31.828364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0673-0471-48e8-883f-34ebff381251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:31.892549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9d9f0673-0471-48e8-883f-34ebff381251 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:31.893779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9d9f0673-0471-48e8-883f-34ebff381251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:31.991305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 754/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:32.033889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9651b4a-2087-4577-9048-cef4f1a5cb1c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:32.035405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b9651b4a-2087-4577-9048-cef4f1a5cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:32.045445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:32.178815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9651b4a-2087-4577-9048-cef4f1a5cb1c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:32.256696 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:32.290423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:32.291038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:32.291321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:32.291595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:32.293233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:32.381396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:32.383066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0216d0-0d4f-462f-9ac6-aec9a3f2f198 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:32.401599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 727/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:34.613684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053671-7370-45b0-8f9c-d99881e7c9a1 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:34.614222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053671-7370-45b0-8f9c-d99881e7c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:34.614222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053671-7370-45b0-8f9c-d99881e7c9a1 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:34.615749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 755/1482] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:34.621236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf3b8-1b60-4874-857c-562c73393c25 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:34.621641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf3b8-1b60-4874-857c-562c73393c25 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:34.621799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf3b8-1b60-4874-857c-562c73393c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:34.685193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-11faf3b8-1b60-4874-857c-562c73393c25 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:34.686397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-11faf3b8-1b60-4874-857c-562c73393c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:34.735525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:34.787512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 728/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:34.823819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5053671-7370-45b0-8f9c-d99881e7c9a1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:34.825411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c5053671-7370-45b0-8f9c-d99881e7c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:34.849127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:34.930202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5053671-7370-45b0-8f9c-d99881e7c9a1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:35.004911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:35.006082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:35.006460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:35.006778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:35.008482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:35.086481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:35.119476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:35.120916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6ebf-4a2c-41c8-adfa-ff920d2fbdd5 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:35.141738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 756/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:37.246190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30514-9f53-4ae4-8ecb-6adcf33e46fc None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:37.246767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30514-9f53-4ae4-8ecb-6adcf33e46fc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:37.246767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30514-9f53-4ae4-8ecb-6adcf33e46fc None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:37.248145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 729/1485] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:37.253386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4528-90e4-45e2-9964-73512dcec227 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:37.253799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4528-90e4-45e2-9964-73512dcec227 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:37.253941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4528-90e4-45e2-9964-73512dcec227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:37.319295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-034c4528-90e4-45e2-9964-73512dcec227 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:37.320517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-034c4528-90e4-45e2-9964-73512dcec227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:37.417886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 757/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:37.457815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30514-9f53-4ae4-8ecb-6adcf33e46fc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:37.459538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0ff30514-9f53-4ae4-8ecb-6adcf33e46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:37.566562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30514-9f53-4ae4-8ecb-6adcf33e46fc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:37.637774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:37.639656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:37.640309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:37.640592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:37.640869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:37.642578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:37.750094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:37.751470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f184f-827c-466c-b01a-2fb19dd96b5f service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:37.769258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 730/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:40.158852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a155f-2b3b-4e04-bfd0-be22b4d1df65 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:40.159421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a155f-2b3b-4e04-bfd0-be22b4d1df65 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:40.159421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a155f-2b3b-4e04-bfd0-be22b4d1df65 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:40.160795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 758/1488] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:40.166661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4deb3f-55e3-4857-b891-941c663e53b7 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:40.167115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4deb3f-55e3-4857-b891-941c663e53b7 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:40.167269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4deb3f-55e3-4857-b891-941c663e53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:40.233465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5f4deb3f-55e3-4857-b891-941c663e53b7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:40.234778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5f4deb3f-55e3-4857-b891-941c663e53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:40.294104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:40.339534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 731/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:40.382752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a155f-2b3b-4e04-bfd0-be22b4d1df65 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:40.384817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e31a155f-2b3b-4e04-bfd0-be22b4d1df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:40.428602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:40.508427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a155f-2b3b-4e04-bfd0-be22b4d1df65 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:40.597487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:40.598145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:40.598432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:40.598737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:40.601168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:40.683646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:40.716811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:40.718267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7556a9-9ab1-4fdf-b79f-d27944409858 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:40.742282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 759/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:43.266945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a161-17ab-442e-9b19-c49c87273bdb None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:43.267510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a161-17ab-442e-9b19-c49c87273bdb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:43.267510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a161-17ab-442e-9b19-c49c87273bdb None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:43.268895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 732/1491] 10.222.0.49 () {54 vars in 926 bytes} [Thu Jul 21 10:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:40:43.274814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cd30-e20c-436a-91b1-5fee6c6e4e22 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:43.275251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cd30-e20c-436a-91b1-5fee6c6e4e22 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:43.275358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719cd30-e20c-436a-91b1-5fee6c6e4e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:43.342487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1719cd30-e20c-436a-91b1-5fee6c6e4e22 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:40:43.343657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1719cd30-e20c-436a-91b1-5fee6c6e4e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:43.560936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 760/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Thu Jul 21 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:40:43.601103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a161-17ab-442e-9b19-c49c87273bdb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:40:43.602720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1a70a161-17ab-442e-9b19-c49c87273bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:43.709374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a161-17ab-442e-9b19-c49c87273bdb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:40:43.783338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:40:43.783994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:40:43.784707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:40:43.784707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:40:43.786196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:40:43.795931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:43.896921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:40:43.898252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02930b38-abce-4593-9c64-01c228fbaf66 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:40:43.917361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 733/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:40:53.559059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=82 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:53.915007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=50 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:19.795507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:19.796039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:19.796039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:19.870356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:42:19.871602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:19.965615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 761/1494] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:42:19.973697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:19.974213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:19.974322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:20.049240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:42:20.050463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:20.147638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 734/1495] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:42:20.153032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:20.154234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:20.165426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c148d-410b-42ab-a8b2-e68bdfed5c87 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:20.225373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:20.258339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:20.259136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:20.259424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:20.259693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:20.261097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:42:20.261395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:20.262390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:20.262390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:42:20.262390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:42:20.263340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:20.275159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 762/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:42:20.284080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:20.293752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215fab1-0e98-4062-904c-0999eaa6a0bb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:20.353173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:20.388579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:20.389231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:20.389510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:20.389782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:20.390475 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:20.392254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:20.392254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:42:20.392254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:42:20.393431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:20.531456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 735/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:42:20 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:42:20.535547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:20.537082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:20.570144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56d0ff-b9eb-420f-869d-89368ef3296a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:20.664113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:20.664784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:20.665060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:20.665329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:20.666036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:20.667124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:20.667124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:42:20.667124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:42:20.668328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:20.764260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 763/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:42:20 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:42:20.768538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:20.770143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:20.832765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13608-f647-4808-8d0b-fd12bc44fe58 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:20.915156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:20.925131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:20.925792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:20.926073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:20.926345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:20.927098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:20.928104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:20.928104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:42:20.928104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:42:20.928982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:20.941611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 736/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:42:20.945773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:20.947295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:20.959206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063201fb-e46f-408c-a784-bdc03c2472b0 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:20.984335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:21.054074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:21.054666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.054977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.055250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:21.055977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:21.057460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:21.057460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:42:21.057460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:42:21.058441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace07b-91db-4298-bd7c-fe52fd727fde admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:21.070485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 764/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:42:21.075350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:21.076851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:21.109368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dead-3577-4777-aaff-e58582fef59d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:21.201959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:21.202898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.203180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.203455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] PATH_INFO: `/v3/projects/549d4fc7f2a64b5d86305d03ff075d3d/users/8d001698442c4a22bf1301a9f8439e9a/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:21.224666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549d4fc7f2a64b5d86305d03ff075d3d, user_id=8d001698442c4a22bf1301a9f8439e9a, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:21.225690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:21.225690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:42:21.225690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:42:21.227658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654fe2-2033-47b4-b4a1-50cc50cd99e6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:21.329482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 737/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:42:21 2022] PUT /identity/v3/projects/549d4fc7f2a64b5d86305d03ff075d3d/users/8d001698442c4a22bf1301a9f8439e9a/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:42:21.342204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e9770-d472-4aed-8453-2db887c553a6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.342501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e9770-d472-4aed-8453-2db887c553a6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.342819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e9770-d472-4aed-8453-2db887c553a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:21.397391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-745e9770-d472-4aed-8453-2db887c553a6 None None] MFA Rules not processed for user `8d001698442c4a22bf1301a9f8439e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:42:21.398612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-745e9770-d472-4aed-8453-2db887c553a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:21.475813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 765/1502] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:42:21.489307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc440b3-2d4c-4bb8-a60f-81b0d9a41ed5 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.489597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc440b3-2d4c-4bb8-a60f-81b0d9a41ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.489875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc440b3-2d4c-4bb8-a60f-81b0d9a41ed5 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:21.491298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 738/1503] 10.222.0.49 () {54 vars in 964 bytes} [Thu Jul 21 10:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:42:21.496592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eaf42-4e2e-40d3-ab72-d72a40d0adee None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.496900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eaf42-4e2e-40d3-ab72-d72a40d0adee None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.497156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eaf42-4e2e-40d3-ab72-d72a40d0adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:21.527496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:21.570160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-781eaf42-4e2e-40d3-ab72-d72a40d0adee None None] MFA Rules not processed for user `992d129919be4586b6e1c9d1fed498b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:42:21.571398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-781eaf42-4e2e-40d3-ab72-d72a40d0adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:21.646951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 766/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Thu Jul 21 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:42:21.655398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc440b3-2d4c-4bb8-a60f-81b0d9a41ed5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:21.656929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5fc440b3-2d4c-4bb8-a60f-81b0d9a41ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:21.707177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:21.761367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc440b3-2d4c-4bb8-a60f-81b0d9a41ed5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:21.835812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:21.836462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.836741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.837013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:21.838716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:21.935944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:21.937312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:21.941159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:21.955708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 739/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:42:21.998774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd968e-a504-4b49-8089-df9feb96be81 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:21.999177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd968e-a504-4b49-8089-df9feb96be81 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:21.999340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd968e-a504-4b49-8089-df9feb96be81 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:22.000676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 767/1506] 10.222.0.49 () {52 vars in 829 bytes} [Thu Jul 21 10:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:42:22.004180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:22.005415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:22.108109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265c86-9853-442b-ae8a-1a9f290e65d0 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:22.200185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:22.200990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:22.201271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:22.201544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] PATH_INFO: `/v3/users/8d001698442c4a22bf1301a9f8439e9a` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:22.213987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d001698442c4a22bf1301a9f8439e9a)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:22.215087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:22.215087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:42:22.215087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:42:22.216300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:22.225679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:22.419290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d001698442c4a22bf1301a9f8439e9a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:22.489089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d001698442c4a22bf1301a9f8439e9a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:22.508840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d001698442c4a22bf1301a9f8439e9a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:22.509283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d001698442c4a22bf1301a9f8439e9a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:22.523959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d001698442c4a22bf1301a9f8439e9a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:22.530001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 740/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:42:22 2022] DELETE /identity/v3/users/8d001698442c4a22bf1301a9f8439e9a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:42:22.534351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:22.534644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:22.534954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:22.589503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:42:22.590740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:22.665053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:22.677370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 768/1508] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:42:22.687683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:22.688893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:22.788335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a27ee-27ec-409b-b670-b2f937cdf39b admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:22.844859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:22.864810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:22.865564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:22.865845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:22.866116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:22.867794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:22.978616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:22.980724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1701-f433-47b0-9222-5e77537f89bf service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:22.999956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 741/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:42:23.478065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:42:23.480678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:42:23.492686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1546495-1986-4b1b-b756-203b06029c20 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:42:23.592254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:42:23.593111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:42:23.593392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:42:23.593665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] PATH_INFO: `/v3/projects/549d4fc7f2a64b5d86305d03ff075d3d` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:42:23.603747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549d4fc7f2a64b5d86305d03ff075d3d)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:42:23.604961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:42:23.604961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:42:23.604961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:42:23.606184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:42:23.723509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549d4fc7f2a64b5d86305d03ff075d3d', 'request_id': 'req-6aada1f6-acfa-4129-be1e-78b2c0267718'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:23.737286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549d4fc7f2a64b5d86305d03ff075d3d', 'request_id': 'req-6aada1f6-acfa-4129-be1e-78b2c0267718'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:23.835716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549d4fc7f2a64b5d86305d03ff075d3d', 'request_id': 'req-6aada1f6-acfa-4129-be1e-78b2c0267718'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:23.860136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] The token cache is being invalidate because project 549d4fc7f2a64b5d86305d03ff075d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:42:23.860427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:23.860858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6aada1f6-acfa-4129-be1e-78b2c0267718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:42:23.862348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 769/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:42:23 2022] DELETE /identity/v3/projects/549d4fc7f2a64b5d86305d03ff075d3d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:42:32.997603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=62 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:42:33.858340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:10.256461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda14d54-f1b4-49d3-a455-d6b085de1254 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:10.257068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda14d54-f1b4-49d3-a455-d6b085de1254 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:10.257068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda14d54-f1b4-49d3-a455-d6b085de1254 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:10.258469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:10.263478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db2d5-9d97-4b61-bf2a-e1663fe5a509 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:10.263983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db2d5-9d97-4b61-bf2a-e1663fe5a509 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:10.264092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db2d5-9d97-4b61-bf2a-e1663fe5a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:10.345893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4e1db2d5-9d97-4b61-bf2a-e1663fe5a509 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:10.347130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4e1db2d5-9d97-4b61-bf2a-e1663fe5a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:10.447809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:10.604682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda14d54-f1b4-49d3-a455-d6b085de1254 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:10.606947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eda14d54-f1b4-49d3-a455-d6b085de1254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:10.725089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda14d54-f1b4-49d3-a455-d6b085de1254 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:10.730479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99a0bf-aa47-4d55-9df7-461e0ee1ca8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:10.731141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99a0bf-aa47-4d55-9df7-461e0ee1ca8c service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:10.731423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99a0bf-aa47-4d55-9df7-461e0ee1ca8c service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:10.731695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99a0bf-aa47-4d55-9df7-461e0ee1ca8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:10.740025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99a0bf-aa47-4d55-9df7-461e0ee1ca8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:10.741582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99a0bf-aa47-4d55-9df7-461e0ee1ca8c service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:10.751416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 743/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:11.583805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0782c4-c84c-472d-a356-9dc0e87124db None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:11.584329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0782c4-c84c-472d-a356-9dc0e87124db None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:11.584329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0782c4-c84c-472d-a356-9dc0e87124db None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:11.585732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:11.590473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66838-fbbc-4f92-977c-ab6ef7a8e3f8 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:11.590951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66838-fbbc-4f92-977c-ab6ef7a8e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:11.591062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66838-fbbc-4f92-977c-ab6ef7a8e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:11.610599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d7d66838-fbbc-4f92-977c-ab6ef7a8e3f8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:11.611824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d7d66838-fbbc-4f92-977c-ab6ef7a8e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:11.619830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:11.770718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0782c4-c84c-472d-a356-9dc0e87124db None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:11.786262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0782c4-c84c-472d-a356-9dc0e87124db None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:11.791802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a855-ac75-48de-ae56-5ca15df73ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:11.792445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a855-ac75-48de-ae56-5ca15df73ef6 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:11.792727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a855-ac75-48de-ae56-5ca15df73ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:11.793001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a855-ac75-48de-ae56-5ca15df73ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:11.802297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a855-ac75-48de-ae56-5ca15df73ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:11.803896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a855-ac75-48de-ae56-5ca15df73ef6 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:11.813901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 772/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:11.912530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f0fa-9ea8-4d26-b73f-d491b239a068 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:11.912946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f0fa-9ea8-4d26-b73f-d491b239a068 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:11.913227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f0fa-9ea8-4d26-b73f-d491b239a068 None None] PATH_INFO: `/v3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:11.914544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 745/1517] 10.222.0.20 () {54 vars in 925 bytes} [Thu Jul 21 10:44:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:44:11.921004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f72bd-cc1e-4fc7-9e29-a1fe937ea4d6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:11.921291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f72bd-cc1e-4fc7-9e29-a1fe937ea4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:11.921775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f72bd-cc1e-4fc7-9e29-a1fe937ea4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:11.979815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-515f72bd-cc1e-4fc7-9e29-a1fe937ea4d6 None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:11.981037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-515f72bd-cc1e-4fc7-9e29-a1fe937ea4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:11.997509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:12.054142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 773/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jul 21 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:21.286312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d2b-a20a-4f12-96d0-7bcd99db3450 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:21.286896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d2b-a20a-4f12-96d0-7bcd99db3450 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:21.287009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d2b-a20a-4f12-96d0-7bcd99db3450 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:21.288344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 746/1519] 10.222.0.49 () {54 vars in 961 bytes} [Thu Jul 21 10:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:21.293324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45c73f-357a-4fa5-a2ce-e6475386622c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:21.293731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45c73f-357a-4fa5-a2ce-e6475386622c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:21.293881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45c73f-357a-4fa5-a2ce-e6475386622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:21.311918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7b45c73f-357a-4fa5-a2ce-e6475386622c None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:21.313727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7b45c73f-357a-4fa5-a2ce-e6475386622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:21.322350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 774/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Jul 21 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:21.330233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d2b-a20a-4f12-96d0-7bcd99db3450 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:21.343373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d2b-a20a-4f12-96d0-7bcd99db3450 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:21.348452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38323a-605d-4cb1-9ef7-d748dcc6c4cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:21.349082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38323a-605d-4cb1-9ef7-d748dcc6c4cd service placement] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:21.349367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38323a-605d-4cb1-9ef7-d748dcc6c4cd service placement] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:21.349644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38323a-605d-4cb1-9ef7-d748dcc6c4cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:21.357810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38323a-605d-4cb1-9ef7-d748dcc6c4cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:21.359548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38323a-605d-4cb1-9ef7-d748dcc6c4cd service placement] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:21.369422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 747/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:23.056938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d0f1-54aa-48a2-94c6-11b555fdbec2 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:23.057464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d0f1-54aa-48a2-94c6-11b555fdbec2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:23.057464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d0f1-54aa-48a2-94c6-11b555fdbec2 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:23.058848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:23.064441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075b636-8a8e-40cd-a92a-f4e729b40cf5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:23.064871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075b636-8a8e-40cd-a92a-f4e729b40cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:23.064974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075b636-8a8e-40cd-a92a-f4e729b40cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:23.083394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8075b636-8a8e-40cd-a92a-f4e729b40cf5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:23.084574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8075b636-8a8e-40cd-a92a-f4e729b40cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:23.092314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:23.246131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d0f1-54aa-48a2-94c6-11b555fdbec2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:23.260953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d0f1-54aa-48a2-94c6-11b555fdbec2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:23.267556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c352c-3534-4f61-b5fc-50520220de28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:23.268196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c352c-3534-4f61-b5fc-50520220de28 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:23.268480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c352c-3534-4f61-b5fc-50520220de28 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:23.268958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c352c-3534-4f61-b5fc-50520220de28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:23.277312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c352c-3534-4f61-b5fc-50520220de28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:23.278963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c352c-3534-4f61-b5fc-50520220de28 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:23.289133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 776/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:24.127260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7a68-b113-4f8b-94f4-75cabc914e5e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:24.127819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7a68-b113-4f8b-94f4-75cabc914e5e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:24.127934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7a68-b113-4f8b-94f4-75cabc914e5e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:24.129247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 10:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:24.134142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12b00-ff02-40d4-b0b4-0eecedd680a1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:24.134566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12b00-ff02-40d4-b0b4-0eecedd680a1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:24.134752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12b00-ff02-40d4-b0b4-0eecedd680a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:24.152930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c7f12b00-ff02-40d4-b0b4-0eecedd680a1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:24.154132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c7f12b00-ff02-40d4-b0b4-0eecedd680a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:24.162799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 10:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:24.316338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b7a68-b113-4f8b-94f4-75cabc914e5e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:24.331063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b7a68-b113-4f8b-94f4-75cabc914e5e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:24.336545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c1dbd-e1df-4dbf-8cb1-d4b9c794d59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:24.337182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1dbd-e1df-4dbf-8cb1-d4b9c794d59d service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:24.337465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1dbd-e1df-4dbf-8cb1-d4b9c794d59d service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:24.337740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1dbd-e1df-4dbf-8cb1-d4b9c794d59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:24.345865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c1dbd-e1df-4dbf-8cb1-d4b9c794d59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:24.347484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c1dbd-e1df-4dbf-8cb1-d4b9c794d59d service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:24.356779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 750/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:28.497764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca9ec-60f2-4e65-8802-7daa8aa0f87f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:28.498307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca9ec-60f2-4e65-8802-7daa8aa0f87f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:28.498425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca9ec-60f2-4e65-8802-7daa8aa0f87f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:28.500341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:28.505726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95284c-f9fc-45df-be24-f94ee2e77094 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:28.506151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95284c-f9fc-45df-be24-f94ee2e77094 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:28.506287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95284c-f9fc-45df-be24-f94ee2e77094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:28.524982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3f95284c-f9fc-45df-be24-f94ee2e77094 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:28.526183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3f95284c-f9fc-45df-be24-f94ee2e77094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:28.534297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:28.608452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca9ec-60f2-4e65-8802-7daa8aa0f87f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:28.611096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9a9ca9ec-60f2-4e65-8802-7daa8aa0f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:28.688769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca9ec-60f2-4e65-8802-7daa8aa0f87f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:28.692341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d497-3671-4ee9-a11e-95e4c71dee86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:28.694572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d497-3671-4ee9-a11e-95e4c71dee86 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:28.694572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d497-3671-4ee9-a11e-95e4c71dee86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:28.694572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d497-3671-4ee9-a11e-95e4c71dee86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:28.702347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d497-3671-4ee9-a11e-95e4c71dee86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:28.703978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d497-3671-4ee9-a11e-95e4c71dee86 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:28.713288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 779/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:30.725491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cb9c-c681-4d15-bf04-b11602c61117 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:30.726057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cb9c-c681-4d15-bf04-b11602c61117 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:30.726057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cb9c-c681-4d15-bf04-b11602c61117 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:30.727419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:30.732608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a2dcb-9e0d-4876-9bb9-206eb3a606fa None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:30.733008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a2dcb-9e0d-4876-9bb9-206eb3a606fa None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:30.733160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a2dcb-9e0d-4876-9bb9-206eb3a606fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:30.751616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-220a2dcb-9e0d-4876-9bb9-206eb3a606fa None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:30.752798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-220a2dcb-9e0d-4876-9bb9-206eb3a606fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:30.760529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:30.795895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40cb9c-c681-4d15-bf04-b11602c61117 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:30.807046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40cb9c-c681-4d15-bf04-b11602c61117 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:30.810577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd8a3-55db-4cf6-b9b2-d194d29f5b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:30.811268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd8a3-55db-4cf6-b9b2-d194d29f5b34 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:30.811550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd8a3-55db-4cf6-b9b2-d194d29f5b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:30.811821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd8a3-55db-4cf6-b9b2-d194d29f5b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:30.821397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd8a3-55db-4cf6-b9b2-d194d29f5b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:30.822839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd8a3-55db-4cf6-b9b2-d194d29f5b34 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:30.832387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 753/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:34.434522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba879-7eb4-4c2a-8146-e4dd7a7e1a91 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:34.435161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba879-7eb4-4c2a-8146-e4dd7a7e1a91 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:34.435161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba879-7eb4-4c2a-8146-e4dd7a7e1a91 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:34.436493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:34.441709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9b8c9-2bf5-4d3c-8ec4-8a2e2f8e7290 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:34.442143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9b8c9-2bf5-4d3c-8ec4-8a2e2f8e7290 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:34.442335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9b8c9-2bf5-4d3c-8ec4-8a2e2f8e7290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:34.448481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=81 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:34.461423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-35a9b8c9-2bf5-4d3c-8ec4-8a2e2f8e7290 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:34.462616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-35a9b8c9-2bf5-4d3c-8ec4-8a2e2f8e7290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:34.471474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:34.774018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ba879-7eb4-4c2a-8146-e4dd7a7e1a91 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:34.775855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-711ba879-7eb4-4c2a-8146-e4dd7a7e1a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:34.841699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:34.855480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ba879-7eb4-4c2a-8146-e4dd7a7e1a91 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:34.862090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f2d4-5f29-4034-976d-a8aa079c3f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:34.862090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f2d4-5f29-4034-976d-a8aa079c3f8e service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:34.862090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f2d4-5f29-4034-976d-a8aa079c3f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:34.862090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f2d4-5f29-4034-976d-a8aa079c3f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:34.870046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f2d4-5f29-4034-976d-a8aa079c3f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:34.871487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f2d4-5f29-4034-976d-a8aa079c3f8e service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:34.881049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 782/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:36.931692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01430b2-d504-41b3-b86a-d095c36ce1e5 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:36.932240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01430b2-d504-41b3-b86a-d095c36ce1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:36.932240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01430b2-d504-41b3-b86a-d095c36ce1e5 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:36.933617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 10:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:44:36.938940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400e982-d366-4e7b-94cc-5284d0418b1b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:36.939338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400e982-d366-4e7b-94cc-5284d0418b1b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:36.939499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400e982-d366-4e7b-94cc-5284d0418b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:36.957612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b400e982-d366-4e7b-94cc-5284d0418b1b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:44:36.958865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b400e982-d366-4e7b-94cc-5284d0418b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:36.966741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:44:37.269745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01430b2-d504-41b3-b86a-d095c36ce1e5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:44:37.271497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d01430b2-d504-41b3-b86a-d095c36ce1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:44:37.285466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01430b2-d504-41b3-b86a-d095c36ce1e5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:44:37.288950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828137b6-7fc4-4084-ad96-dfe3ebf4acac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:44:37.289580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828137b6-7fc4-4084-ad96-dfe3ebf4acac service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:44:37.289864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828137b6-7fc4-4084-ad96-dfe3ebf4acac service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:44:37.290135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828137b6-7fc4-4084-ad96-dfe3ebf4acac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:44:37.298962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828137b6-7fc4-4084-ad96-dfe3ebf4acac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:44:37.300406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828137b6-7fc4-4084-ad96-dfe3ebf4acac service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:44:37.309588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 756/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:44:46.952271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=11 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:47.305511 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=8 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.170763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.171419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.171419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.196092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.197339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.208513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 784/1540] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:10.218246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96518-f727-435d-8366-da66b2d756b1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.218836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96518-f727-435d-8366-da66b2d756b1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.218836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96518-f727-435d-8366-da66b2d756b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.243410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2ff96518-f727-435d-8366-da66b2d756b1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.245369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2ff96518-f727-435d-8366-da66b2d756b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.262145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 757/1541] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.266722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.275594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8464-e8b7-4e4e-9cb6-2a8a928f5b96 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.275957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8464-e8b7-4e4e-9cb6-2a8a928f5b96 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.276216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b8464-e8b7-4e4e-9cb6-2a8a928f5b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.281269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3128f2-861a-4e94-90a3-f56071000214 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.290666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.291445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.291772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.292055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.292804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:10.293114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.294758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.318113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a69b8464-e8b7-4e4e-9cb6-2a8a928f5b96 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.319396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a69b8464-e8b7-4e4e-9cb6-2a8a928f5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.325112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 785/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:10.333459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.342642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 758/1543] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.349405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e2c8-8b98-40b4-a2c3-43eb2b94d4f7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.351627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d012-d15a-40f5-91bd-e1c95448e25a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.351919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d012-d15a-40f5-91bd-e1c95448e25a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.352204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d012-d15a-40f5-91bd-e1c95448e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.367761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.368476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.368765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.369072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.370478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.371477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:46:10.371477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:46:10.371477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:46:10.373792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.390625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-daf3d012-d15a-40f5-91bd-e1c95448e25a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.391880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-daf3d012-d15a-40f5-91bd-e1c95448e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.410341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 759/1544] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:10.411678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853535f-5e3b-4da0-a780-013badc9a553 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.411971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853535f-5e3b-4da0-a780-013badc9a553 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.412253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853535f-5e3b-4da0-a780-013badc9a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.442225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8853535f-5e3b-4da0-a780-013badc9a553 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.443365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8853535f-5e3b-4da0-a780-013badc9a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.452755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 760/1545] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.454003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c217bc-aed1-43d7-b019-e351e7641d28 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.454464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c217bc-aed1-43d7-b019-e351e7641d28 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.454583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c217bc-aed1-43d7-b019-e351e7641d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.472551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b9c217bc-aed1-43d7-b019-e351e7641d28 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.473763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b9c217bc-aed1-43d7-b019-e351e7641d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.481962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 761/1546] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.483198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0584-78b9-4027-91af-4a5fa76d5253 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.483486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0584-78b9-4027-91af-4a5fa76d5253 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.483762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0584-78b9-4027-91af-4a5fa76d5253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.499014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 786/1547] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:46:10.499862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.502501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e1ab0584-78b9-4027-91af-4a5fa76d5253 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.503838 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e1ab0584-78b9-4027-91af-4a5fa76d5253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.562808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e272-e576-4ddc-84c3-a5e1bf5404a9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.564919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 762/1548] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.566064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5ca7d-1ef1-4ee4-abcb-3b642b801be4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.566356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5ca7d-1ef1-4ee4-abcb-3b642b801be4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.566664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5ca7d-1ef1-4ee4-abcb-3b642b801be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.567856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.568621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.568968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.569309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.570114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:10.570487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.572219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e1730-856f-424e-ad86-8ab32c53201a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.584126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 787/1549] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:10.585449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a377-73f5-47e7-a3dc-672f2c2f40e7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.585742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a377-73f5-47e7-a3dc-672f2c2f40e7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.586021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a377-73f5-47e7-a3dc-672f2c2f40e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.591112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-62b5ca7d-1ef1-4ee4-abcb-3b642b801be4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.592408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-62b5ca7d-1ef1-4ee4-abcb-3b642b801be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.601111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 763/1550] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.603572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce43f1-9d9b-4ecf-bf05-78620aefe333 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.603572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce43f1-9d9b-4ecf-bf05-78620aefe333 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.603572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce43f1-9d9b-4ecf-bf05-78620aefe333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.615009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1c21a377-73f5-47e7-a3dc-672f2c2f40e7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.616252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1c21a377-73f5-47e7-a3dc-672f2c2f40e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.622153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-cdce43f1-9d9b-4ecf-bf05-78620aefe333 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.623347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cdce43f1-9d9b-4ecf-bf05-78620aefe333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.624864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 788/1551] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.628090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a55af-0eca-4769-a723-259f31ff6a72 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.628386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a55af-0eca-4769-a723-259f31ff6a72 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.628700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a55af-0eca-4769-a723-259f31ff6a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.634621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 764/1552] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.634621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.634621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.634621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.651516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.651704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-5a8a55af-0eca-4769-a723-259f31ff6a72 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.652822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.652957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5a8a55af-0eca-4769-a723-259f31ff6a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.660562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 765/1553] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.661282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.662816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 789/1554] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.664225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.664697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.664981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.671904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1f0e-8ef8-4376-8d45-1454fcc3ed72 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.676527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.677183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.677461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.677732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.678421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.679472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:46:10.679472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:46:10.679472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:46:10.680672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e197-ceb1-4595-aeaa-a2a314a43c3d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.685157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.686380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.694599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 790/1555] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.695349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.704992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206839f9-a025-454f-87ba-dcc2e78feddd None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.709601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9ccad-7254-483e-8b48-f531db176b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.710260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ccad-7254-483e-8b48-f531db176b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.710564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ccad-7254-483e-8b48-f531db176b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.710860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ccad-7254-483e-8b48-f531db176b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.711566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9ccad-7254-483e-8b48-f531db176b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.713501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9ccad-7254-483e-8b48-f531db176b03 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.793537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 766/1556] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:10.793537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.793537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.793537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.806753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 791/1557] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:10.806753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.806753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.806753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.811321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.812612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.825943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.827158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.872617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 767/1558] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.873454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.882772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fe354-caf8-4172-ae39-5f89ffea9135 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.888394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.888842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 792/1559] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.889049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.889335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.889615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.889700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.890412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:10.890753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.891773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:46:10.891773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:46:10.891773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:46:10.892723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1e42b-1fdc-400f-8c65-7954cb0f09ec admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.894133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.899250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac3731-b50b-4ee9-ba92-e1b152fe2f14 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.905441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 768/1560] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:10.905598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.906426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.906547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.906821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.907006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.907124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.907448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.908318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:10.908684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.910376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.922907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 793/1561] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:10.923908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.926134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:10.927353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:10.935212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc571eb-cfe2-4e83-bcb8-fb7e49f2d0f1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.940020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 769/1562] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:10.940020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.940231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.940663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.940947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.941226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.941961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:10.942267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.943923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.946962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442fc72-803c-4844-ad81-1c9d10b02e13 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.952787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.953437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.953727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.954058 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.954824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.956497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.958991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 794/1563] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:10.959826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.962326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.968932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 770/1564] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:10.968932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:10.981049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309e12-f06a-4f35-8583-9c557797cb81 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.981049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.981049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.981049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.981436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.981436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.981600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef095147-cd9f-4935-ae79-43fd8d4cfb63 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:10.981701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:10.982643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:10.983314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:10.983601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:10.983877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:10.984633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:10.985079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:10.986716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.000439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 771/1565] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:11.001222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.011591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d47b8-678c-4dbd-af45-42235442ec59 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.016208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.016836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.017118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.017392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.018105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:11.018466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.020039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.031358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 772/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:11.032096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.041748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9360ac4-1ec6-4c00-8a78-59a6a08d08bb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.046495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.047315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.047602 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.048505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.048641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.050543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.072032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 795/1567] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:10 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.073571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.083635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8e8d-66f3-4204-92f2-fc8bb5f805b9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.088283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.089130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.089417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.089695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.090404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.092323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.161726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 773/1568] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.162547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.194072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 796/1569] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.194072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.228468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542258ac-41bd-407b-beb0-689cd466d171 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.255786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e0c46-7f46-4042-a11d-455cb711d5b9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.260956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.261605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.261887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.262158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.262868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.264750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.287272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.289328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.289328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.289328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.289328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:11.289698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.291237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.303302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 774/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:11.304089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.314345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0710b-b772-400d-91f4-d1b5ee4a031c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.318909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.319537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.319819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.320093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.320798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.322343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.332595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 775/1571] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:11.333339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.342962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620908-4c47-45fc-8733-00ab4956420c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.347414 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.348004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.348286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.348553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.349208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.351069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.367913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 797/1572] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.368785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.430271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfec02d-e69f-469a-a7c9-b6aa6aaadc4f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.436082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.436733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.437014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.437288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.437964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.439991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.461638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 776/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.465047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.485132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:11.524675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e3ac5-7b0b-4350-b99b-d29a16ed7108 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.530066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.530801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.531063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.531332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.532050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.533624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.544596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 777/1574] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:11.545494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.550865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 798/1575] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.550865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.556083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab3adf-7ad6-4f77-a7d7-7c4a36587389 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.558724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:11.610995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991db09-9d38-4640-9ccc-4cf7ada56823 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.614742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.615556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.615845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.616122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.616267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.616812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.616927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.617208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.617490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.618173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.618807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.621326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.703730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 778/1576] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.704537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.714551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c97f-7991-477a-a887-9dfbbe972793 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.719170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.719803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.720093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.720390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.721077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.723039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.753089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 799/1577] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.753941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.763534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45d4af-7acc-4bdb-b324-223f4b371497 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.768252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.769121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.769408 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.769686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] PATH_INFO: `/v3/projects/c4f9408b30ad46dd96d7fa679ffcee00/users/8f5546b16c9f4e8686fd960d0c4120b4/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.785752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f9408b30ad46dd96d7fa679ffcee00, user_id=8f5546b16c9f4e8686fd960d0c4120b4, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.786860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:46:11.786860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:46:11.786860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:46:11.788843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.825233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 779/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:11.826041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.875965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 800/1579] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:11 2022] PUT /identity/v3/projects/c4f9408b30ad46dd96d7fa679ffcee00/users/8f5546b16c9f4e8686fd960d0c4120b4/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:11.877158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:11.903434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbe75-42e7-49aa-b3d8-721b7ba73313 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.933550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:11.941115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13091-39e2-44ac-9925-2025b66deb49 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:11.945684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.946353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.946636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.946934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.947617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.950149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:11.961697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:11.962441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:11.962740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:11.963052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:11.963777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:11.965722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.051829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 801/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:12.052582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.062976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc533857-e73e-45b4-8da4-bab0a5a18253 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.067586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.068216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.068500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.068773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.069493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.071132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.077870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 780/1581] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:11 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:12.078650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.084365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 802/1582] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.085270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.091541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ff53-7190-4b2d-bb58-95485ec43e87 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.095120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dff20a-19a5-4870-b8a8-ef32a3a6d7b1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.096472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e488-0e13-4dcf-a8f3-7675e2733376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.097133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e488-0e13-4dcf-a8f3-7675e2733376 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.097418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e488-0e13-4dcf-a8f3-7675e2733376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.097692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e488-0e13-4dcf-a8f3-7675e2733376 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.098411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e488-0e13-4dcf-a8f3-7675e2733376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.100036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.100431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e488-0e13-4dcf-a8f3-7675e2733376 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.100731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.101123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.101404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.102130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.103728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.115310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 803/1583] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.116321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.126495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1495-b961-4cd1-8b0f-2113933c31bc admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.131102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.131736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.133587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.133587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.133587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.134565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.144552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 804/1584] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.145171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.154534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0110393-419e-4eeb-8e63-0c33e3219d04 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.159544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.162372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.162372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.162372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.162372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.163245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.186893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 781/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:12 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:12.188169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910b74-84b4-481b-975e-11f2c938794f None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.188455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910b74-84b4-481b-975e-11f2c938794f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.188732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90910b74-84b4-481b-975e-11f2c938794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.214322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-90910b74-84b4-481b-975e-11f2c938794f None None] MFA Rules not processed for user `8f5546b16c9f4e8686fd960d0c4120b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:12.215564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-90910b74-84b4-481b-975e-11f2c938794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:12.260278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 805/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:12 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:12.261109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.270565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927062-8d4a-46f7-9c79-1d4033195435 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.275227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.275896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.276181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.276456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.277318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.278931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.283682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 782/1587] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:12.284668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:12.287562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90910b74-84b4-481b-975e-11f2c938794f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.292862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 806/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.293224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.303228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90910b74-84b4-481b-975e-11f2c938794f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.303358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd35d4-f1a4-4b5f-837b-c263bb3548d1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.304417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.305082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.305430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.305637 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.306364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.308777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.309065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.309944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.310220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.310494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] PATH_INFO: `/v3/projects/65eddd2fb2d141dda930feaf8f372172/users/18afdb5efe8647ffacf22debc24b44ba/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.319032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 783/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.319826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.326416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65eddd2fb2d141dda930feaf8f372172, user_id=18afdb5efe8647ffacf22debc24b44ba, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.329813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.329956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125525-41fb-4f56-9552-d5be42119d33 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.334924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.335580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.335864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.336138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.336858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.338465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.348807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 784/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.349728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.360130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9571c1-0233-4144-a67c-5650793310fc admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.364992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.365549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.365832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.366109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.366915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.368489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.379657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 785/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.380435 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.389817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d9b7-17b5-418e-83a9-b2f183a32aac admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.395461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 807/1592] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:12 2022] PUT /identity/v3/projects/65eddd2fb2d141dda930feaf8f372172/users/18afdb5efe8647ffacf22debc24b44ba/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:12.396569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.452592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.453262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.453656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.453937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.454667 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.456284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.457528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:12.459908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411023f-1a78-441c-a285-82567bcf8878 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.465559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.466207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.466497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.466826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.468033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.468199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 786/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.468470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.469160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.480337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 808/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.481128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.490998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4e958-a3ff-4c48-8f19-d8927e8359c5 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.495899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.496721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.496849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.497083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.497957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.499569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.509711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 809/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.510575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.520047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0964874-a70b-4917-ac64-29cc79c945fa admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.524862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.525506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.526321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.526599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.527361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.528938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.532909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09f2c-5ed5-4395-817f-8157bf46424e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.536583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.537228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.537510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.537787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.539302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 810/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.540055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.550370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8e00-dccd-4f70-ac5e-6ce9df7934cc admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.555020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb5a99-9fc1-4dcd-bd29-62002444399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.555809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb5a99-9fc1-4dcd-bd29-62002444399d admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.556086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb5a99-9fc1-4dcd-bd29-62002444399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.556354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb5a99-9fc1-4dcd-bd29-62002444399d admin admin] PATH_INFO: `/v3/projects/9c2701c39e76474c96060130d8d47bcb/users/56083498939444d3b06f6282ed22d253/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.571141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb5a99-9fc1-4dcd-bd29-62002444399d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2701c39e76474c96060130d8d47bcb, user_id=56083498939444d3b06f6282ed22d253, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.574064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb5a99-9fc1-4dcd-bd29-62002444399d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.599577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.601018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.611314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 787/1597] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:12.612131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.622924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88045-3425-48c7-93d7-9501c93aec6b service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.627641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.628542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.628825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.629103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] PATH_INFO: `/v3/projects/24eafbd2d9fa4e13a0a379dc9d2ea36e/users/5c6586cbd05e4b49b8ff44b09bc7d51f/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.643972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24eafbd2d9fa4e13a0a379dc9d2ea36e, user_id=5c6586cbd05e4b49b8ff44b09bc7d51f, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.646675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.646802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 811/1598] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:12 2022] PUT /identity/v3/projects/9c2701c39e76474c96060130d8d47bcb/users/56083498939444d3b06f6282ed22d253/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:12.648198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.648495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.648769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.667337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:12.668523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:12.731413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 788/1599] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:12 2022] PUT /identity/v3/projects/24eafbd2d9fa4e13a0a379dc9d2ea36e/users/5c6586cbd05e4b49b8ff44b09bc7d51f/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:12.731413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.732864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 812/1600] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:12.738971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.750371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a123c-791f-4464-af15-7f7b3055b278 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.786865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:12.804337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb523ea-8cae-4353-a5a4-3af0856a76b1 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.809445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.810207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.810613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.810928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.811670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.813280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.827053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.827053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.827053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.827053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.827400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.827485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 789/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.827485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.827837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.837552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 813/1602] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:12.838154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca79e7-5113-420f-8e5f-783054b99545 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.839425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:12.844349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e890e-b597-490b-ad7f-fb4fa958435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.845279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e890e-b597-490b-ad7f-fb4fa958435f admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.845568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e890e-b597-490b-ad7f-fb4fa958435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.845845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e890e-b597-490b-ad7f-fb4fa958435f admin admin] PATH_INFO: `/v3/projects/3b255ebf80ff409dab26dca4145f7a39/users/d1282d4187a54299836bb6b4300d15c1/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.852399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bacb-4efe-40a6-88de-2e475b5cfa6a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:12.858405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968152b3-a7b9-4118-9baa-5b930eedfb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:12.859411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968152b3-a7b9-4118-9baa-5b930eedfb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.859696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968152b3-a7b9-4118-9baa-5b930eedfb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.860185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968152b3-a7b9-4118-9baa-5b930eedfb61 admin admin] PATH_INFO: `/v3/projects/d2e40cd799fc4057bc62d9f40df79884/users/12305af61a2941fe81075b7e6609c53e/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.863481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e890e-b597-490b-ad7f-fb4fa958435f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b255ebf80ff409dab26dca4145f7a39, user_id=d1282d4187a54299836bb6b4300d15c1, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.866697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e890e-b597-490b-ad7f-fb4fa958435f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.877169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968152b3-a7b9-4118-9baa-5b930eedfb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e40cd799fc4057bc62d9f40df79884, user_id=12305af61a2941fe81075b7e6609c53e, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:12.879944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968152b3-a7b9-4118-9baa-5b930eedfb61 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:12.961898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:12.968970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 814/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:12 2022] PUT /identity/v3/projects/d2e40cd799fc4057bc62d9f40df79884/users/12305af61a2941fe81075b7e6609c53e/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:12.975490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 790/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:12 2022] PUT /identity/v3/projects/3b255ebf80ff409dab26dca4145f7a39/users/d1282d4187a54299836bb6b4300d15c1/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:12.975655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.975655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.975655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.975958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:12.975958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:12.975958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:12.994582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:12.996749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:12.997263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:12.998434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.057993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 815/1605] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:13.061821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 791/1606] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:13.062066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.062631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.062751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.076825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbdb5b-67c7-4b1f-8ecc-6df6674b50a1 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.082156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784881-bea5-439c-a1aa-500aa094a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.082715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784881-bea5-439c-a1aa-500aa094a475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.083024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784881-bea5-439c-a1aa-500aa094a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.083302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784881-bea5-439c-a1aa-500aa094a475 admin admin] PATH_INFO: `/v3/projects/e7864ffb9df540e7b74d29062e2afead/users/935ae6133b0442bb919c73dd5297629c/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.100642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0784881-bea5-439c-a1aa-500aa094a475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7864ffb9df540e7b74d29062e2afead, user_id=935ae6133b0442bb919c73dd5297629c, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.103339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0784881-bea5-439c-a1aa-500aa094a475 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.122202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3b10-da66-4426-bb02-587d8ec2ea3c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.125833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.126505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.126789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.127078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.138201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.139809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.149619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 816/1607] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:13.150380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.160570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14198e-8ecd-4093-9984-fec8872d41f0 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.165773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.168725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.168725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.168725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] PATH_INFO: `/v3/projects/f05a09327a2242659c488392f39bb1aa/users/3d9f44e96d854099910249ad1c166ffc/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.183947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05a09327a2242659c488392f39bb1aa, user_id=3d9f44e96d854099910249ad1c166ffc, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.186703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.197578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 792/1608] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:13 2022] PUT /identity/v3/projects/e7864ffb9df540e7b74d29062e2afead/users/935ae6133b0442bb919c73dd5297629c/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:13.203096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739869-b140-4447-9a29-ca851ec0d899 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.203096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739869-b140-4447-9a29-ca851ec0d899 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.203096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739869-b140-4447-9a29-ca851ec0d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.219212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-dd739869-b140-4447-9a29-ca851ec0d899 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:13.220695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dd739869-b140-4447-9a29-ca851ec0d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.280059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 793/1609] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:13.287597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.287597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.287597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.301284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:13.302658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.311733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 794/1610] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:13.313148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.332288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 817/1611] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:13 2022] PUT /identity/v3/projects/f05a09327a2242659c488392f39bb1aa/users/3d9f44e96d854099910249ad1c166ffc/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:13.333320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.368495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:13.406368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588700-bd70-422b-9425-33a3e4b808f1 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.417626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3946-3b57-4ecc-a3e0-1f94dea6dd2d admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.421388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1e241-51a9-4505-baf5-fb810bc823c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.422047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1e241-51a9-4505-baf5-fb810bc823c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.422330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1e241-51a9-4505-baf5-fb810bc823c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.422604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1e241-51a9-4505-baf5-fb810bc823c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.457985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.458649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.458961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.459239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.484907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1e241-51a9-4505-baf5-fb810bc823c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.486373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1e241-51a9-4505-baf5-fb810bc823c7 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.496320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:13.497320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 818/1612] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:13.498886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84297-d837-4ad6-9c48-a756b3d5929b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.499242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84297-d837-4ad6-9c48-a756b3d5929b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.499564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84297-d837-4ad6-9c48-a756b3d5929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.529600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-20e84297-d837-4ad6-9c48-a756b3d5929b None None] MFA Rules not processed for user `935ae6133b0442bb919c73dd5297629c`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:13.531188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-20e84297-d837-4ad6-9c48-a756b3d5929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.537842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.539930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.554021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 795/1613] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:13.554936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.566491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a79491-b1a9-4370-9404-38dc83cd79c9 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.570530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.571057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.571414 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.571695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.581964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.583469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.600531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 796/1614] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:13.601444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.609317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 819/1615] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:13.609317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.609317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.609317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.634534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa4a2a-8587-4c69-abb1-3cd6496e0759 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.641451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] MFA Rules not processed for user `3d9f44e96d854099910249ad1c166ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:13.642853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.660005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334efa4-3c2f-45e0-80f9-6e705d0297e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.660703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334efa4-3c2f-45e0-80f9-6e705d0297e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.665967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334efa4-3c2f-45e0-80f9-6e705d0297e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.666307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334efa4-3c2f-45e0-80f9-6e705d0297e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.694002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334efa4-3c2f-45e0-80f9-6e705d0297e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.695693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334efa4-3c2f-45e0-80f9-6e705d0297e2 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.710080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 797/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:13.711738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541075cf-23df-42f7-a112-80d2f1ea3329 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.715683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541075cf-23df-42f7-a112-80d2f1ea3329 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.715683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541075cf-23df-42f7-a112-80d2f1ea3329 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.715683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 798/1617] 10.222.0.49 () {54 vars in 962 bytes} [Thu Jul 21 10:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:13.719984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.720434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.720868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.738963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 820/1618] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:13.748033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.768072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3371-c293-407c-832a-3f546d1e4930 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.782448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f117fc-7b56-4ddc-85a1-6bd2c607132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.782448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f117fc-7b56-4ddc-85a1-6bd2c607132e admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.782886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f117fc-7b56-4ddc-85a1-6bd2c607132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.784406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f117fc-7b56-4ddc-85a1-6bd2c607132e admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.785337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f117fc-7b56-4ddc-85a1-6bd2c607132e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.789852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f117fc-7b56-4ddc-85a1-6bd2c607132e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.798724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:13.802170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:13.841385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:13.939870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 799/1619] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Jul 21 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:13.949164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:13.961557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b0eea-6f22-4001-ac0d-47e7f073a45c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:13.970361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:13.971335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:13.971729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:13.972140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:13.985169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:13.987175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:13.999683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 800/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:14.046327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 821/1621] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:13 2022] POST /identity/v3/projects => generated 363 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:14.050547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.062896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ee28c-89ce-45d3-b2b2-852f88a8743f service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:14.123654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:14.126218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.126218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.126218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.126218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:14.128047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:14.249658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d19e7-f514-4b9a-94c8-ab8ed093c165 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.251112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d19e7-f514-4b9a-94c8-ab8ed093c165 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.251465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d19e7-f514-4b9a-94c8-ab8ed093c165 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.253425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 822/1622] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 21 10:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:14.261256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.261700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.262150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.292699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:14.294029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:14.296237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 801/1623] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:14 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:14.298743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.310714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98be68-8fec-4f66-b79f-39b00156f841 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:14.318906 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:14.319660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.320001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.320283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.321173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:14.328461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:14.337264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 802/1624] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:46:14.342746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.358241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2f34-2844-4bf5-81a9-c3e2dc74290d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:14.365285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:14.367650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.367956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.368534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] PATH_INFO: `/v3/projects/c37d893cb6de4d3593f66812278b348e/users/32048dc7b3d247df9b6ff0ae102e6c0c/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.388713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37d893cb6de4d3593f66812278b348e, user_id=32048dc7b3d247df9b6ff0ae102e6c0c, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:14.392423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:14.441860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 823/1625] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:14.456941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.506425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 803/1626] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:14 2022] PUT /identity/v3/projects/c37d893cb6de4d3593f66812278b348e/users/32048dc7b3d247df9b6ff0ae102e6c0c/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:14.511444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.512852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07c1d-af7b-4ae5-bbe4-02efddb13ee1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:14.575211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:14.576416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.576775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.577234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.602624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:14.609968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0ec5-5e13-4e2b-9f79-2c8cfb55e023 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:14.616701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:14.618103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.618461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.618840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.619871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:14.622100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:14.638346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 804/1627] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:14.646932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.663879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb5d3-c532-49fd-8a8a-3f74bc4992fe admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:14.672786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d315c53-2a36-4880-8a61-fa25fa526bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:14.674143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d315c53-2a36-4880-8a61-fa25fa526bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.675211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d315c53-2a36-4880-8a61-fa25fa526bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.675694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d315c53-2a36-4880-8a61-fa25fa526bca admin admin] PATH_INFO: `/v3/projects/c37d893cb6de4d3593f66812278b348e/users/32048dc7b3d247df9b6ff0ae102e6c0c/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.679251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d315c53-2a36-4880-8a61-fa25fa526bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37d893cb6de4d3593f66812278b348e, user_id=32048dc7b3d247df9b6ff0ae102e6c0c, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:14.683299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d315c53-2a36-4880-8a61-fa25fa526bca admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:14.686230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:14.687383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:14.694493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:14.706680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 805/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:14 2022] PUT /identity/v3/projects/c37d893cb6de4d3593f66812278b348e/users/32048dc7b3d247df9b6ff0ae102e6c0c/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:14.711501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 824/1629] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:14.716264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d752b-b183-4533-a7d2-0326e9eb7eb5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:14.716686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d752b-b183-4533-a7d2-0326e9eb7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:14.717040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d752b-b183-4533-a7d2-0326e9eb7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:14.776598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d79d752b-b183-4533-a7d2-0326e9eb7eb5 None None] MFA Rules not processed for user `32048dc7b3d247df9b6ff0ae102e6c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:14.778155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d79d752b-b183-4533-a7d2-0326e9eb7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:14.943976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 806/1630] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:14.956399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:14.964901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f463-5e34-48e2-bcc5-142f9affcc47 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:15.045569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:15.046343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:15.048669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:15.049040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:15.065153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:15.066766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:15.079559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 825/1631] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:15.220552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:15.534140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:15.534817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:15.534817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:15.574174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] MFA Rules not processed for user `18afdb5efe8647ffacf22debc24b44ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:15.575687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:15.660335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 807/1632] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:15.664910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:15.741477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759f713-5fa4-4190-b71c-c522834ab8f6 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:15.747290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12482-da25-45a6-beff-0b73ce554df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:15.747921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12482-da25-45a6-beff-0b73ce554df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:15.748084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12482-da25-45a6-beff-0b73ce554df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:15.748365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12482-da25-45a6-beff-0b73ce554df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:15.749060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee12482-da25-45a6-beff-0b73ce554df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:15.762052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee12482-da25-45a6-beff-0b73ce554df1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:15.899799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 826/1633] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:15 2022] POST /identity/v3/projects => generated 403 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:15.904783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:15.922567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb219c4d-98c2-4bed-b565-1e75de337424 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:15.995522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7093-89ba-4f68-9bcd-43bce79ce48e None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:15.995817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7093-89ba-4f68-9bcd-43bce79ce48e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:15.996152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7093-89ba-4f68-9bcd-43bce79ce48e None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:15.997916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 827/1634] 10.222.0.49 () {54 vars in 962 bytes} [Thu Jul 21 10:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:16.006299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3b751-0b33-4a94-b66f-feec3dfd264d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.006592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3b751-0b33-4a94-b66f-feec3dfd264d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.006899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3b751-0b33-4a94-b66f-feec3dfd264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.037753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0de3b751-0b33-4a94-b66f-feec3dfd264d None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:16.039617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0de3b751-0b33-4a94-b66f-feec3dfd264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:16.084140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:16.084846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.085134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.085411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.086271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:16.091421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:16.137751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:16.213964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 828/1635] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Jul 21 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:16.220148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1f6da-7364-4b5b-ae71-2488ae0dc86f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.220406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1f6da-7364-4b5b-ae71-2488ae0dc86f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.220653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1f6da-7364-4b5b-ae71-2488ae0dc86f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.222378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 829/1636] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 21 10:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:46:16.227760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.228052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.228334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.241417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 808/1637] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:15 2022] POST /identity/v3/users => generated 308 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:16.245652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:16.264893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4efa77-da37-4362-8e3e-40a522a929f9 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:16.271297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:16.272516 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:16.276975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:16.278577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.279092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.279559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.280884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:16.284139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:16.296833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 830/1638] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:16.305565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 809/1639] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:46:16.307903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:16.521684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580befe-e9ba-4671-8a75-559a1412c183 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:16.524092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:16.524468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:16.524468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.524468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.524468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] PATH_INFO: `/v3/projects/a093dbaad47a4a27a7358b8222d83af2/users/77c86031e3344ee5ba394b2f03ce13d3/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.524720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a093dbaad47a4a27a7358b8222d83af2, user_id=77c86031e3344ee5ba394b2f03ce13d3, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:16.524720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:16.524836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939ff0-1e2a-44ef-ac95-fe5aa2625e1e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:16.524836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:16.524983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 831/1640] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:16 2022] PUT /identity/v3/projects/a093dbaad47a4a27a7358b8222d83af2/users/77c86031e3344ee5ba394b2f03ce13d3/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:16.524983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:16.567322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:16.569026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.569405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.569770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.654188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e78a6e-23b7-474f-962d-a691552d81fd admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:16.662980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:16.663852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.664238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.664654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.665588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:16.666165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:16.668524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:16.668643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:16.685229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 810/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:16.690638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 832/1642] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:16.690984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:16.703948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6b7a-a8b7-48e0-8042-72bdb68da2b7 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:16.709022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40631ab-8a26-40c6-ad3f-119e4b9cf2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:16.714373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40631ab-8a26-40c6-ad3f-119e4b9cf2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:16.714373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40631ab-8a26-40c6-ad3f-119e4b9cf2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:16.714373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40631ab-8a26-40c6-ad3f-119e4b9cf2cc admin admin] PATH_INFO: `/v3/projects/a093dbaad47a4a27a7358b8222d83af2/users/77c86031e3344ee5ba394b2f03ce13d3/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:16.715190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40631ab-8a26-40c6-ad3f-119e4b9cf2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a093dbaad47a4a27a7358b8222d83af2, user_id=77c86031e3344ee5ba394b2f03ce13d3, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:16.717874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40631ab-8a26-40c6-ad3f-119e4b9cf2cc admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:16.735311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 811/1643] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:16 2022] PUT /identity/v3/projects/a093dbaad47a4a27a7358b8222d83af2/users/77c86031e3344ee5ba394b2f03ce13d3/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:16.900077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:16.911682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66665bcf-5491-4084-9aa1-9a1d7c9d5159 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:17.056764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:17.056764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:17.056764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:17.056764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] PATH_INFO: `/v3/users/3d9f44e96d854099910249ad1c166ffc` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:17.058463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9f44e96d854099910249ad1c166ffc)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:17.059627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: WARNING py.warnings [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:46:17.059627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: warnings.warn(msg) Jul 21 10:46:17.059627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: Jul 21 10:46:17.060857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:17.400614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9f44e96d854099910249ad1c166ffc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:17.514194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9f44e96d854099910249ad1c166ffc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:17.515545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9f44e96d854099910249ad1c166ffc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:17.543794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9f44e96d854099910249ad1c166ffc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:17.574461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9f44e96d854099910249ad1c166ffc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:17.590021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 833/1644] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:16 2022] DELETE /identity/v3/users/3d9f44e96d854099910249ad1c166ffc => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:17.600367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:17.600367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:17.600367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:17.615033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:17.616492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:17.696378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 812/1645] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:17.714715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:17.716374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:17.812137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f4a7b-9bc0-4c03-96da-eb868b8ef2f7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:17.820777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:17.821799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:17.822293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:17.822889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:17.838379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:17.840880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:17.853783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 834/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:18.093087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:18.659181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:18.660690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:18.685498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7484a1a-4c72-49a5-9cf4-e83e5a354d06 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:18.694097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:18.695189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:18.696189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:18.696621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] PATH_INFO: `/v3/projects/f05a09327a2242659c488392f39bb1aa` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:18.703643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05a09327a2242659c488392f39bb1aa)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:18.706039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: WARNING py.warnings [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:46:18.706039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: warnings.warn(msg) Jul 21 10:46:18.706039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: Jul 21 10:46:18.709512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:18.720378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:18.722640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:18.739422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea078a6-6695-4296-bcd0-84cb8609a908 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:18.747781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:18.750254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:18.750973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:18.751483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] PATH_INFO: `/v3/users/935ae6133b0442bb919c73dd5297629c` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:18.753429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935ae6133b0442bb919c73dd5297629c)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:18.756046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:18.795087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:19.102025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935ae6133b0442bb919c73dd5297629c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.131198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05a09327a2242659c488392f39bb1aa', 'request_id': 'req-25ecf5dd-2701-4c02-b649-140d76921add'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.163897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05a09327a2242659c488392f39bb1aa', 'request_id': 'req-25ecf5dd-2701-4c02-b649-140d76921add'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.228499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935ae6133b0442bb919c73dd5297629c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.232967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935ae6133b0442bb919c73dd5297629c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.294112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935ae6133b0442bb919c73dd5297629c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.326533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05a09327a2242659c488392f39bb1aa', 'request_id': 'req-25ecf5dd-2701-4c02-b649-140d76921add'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.326963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d9aa5c8d-8996-44cf-861e-be22485f84c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935ae6133b0442bb919c73dd5297629c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.342855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] The token cache is being invalidate because project f05a09327a2242659c488392f39bb1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:19.343373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.344823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:19.350294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 813/1647] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:18 2022] DELETE /identity/v3/projects/f05a09327a2242659c488392f39bb1aa => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:19.353323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 835/1648] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:18 2022] DELETE /identity/v3/users/935ae6133b0442bb919c73dd5297629c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:19.373501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:19.377640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:19.408022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:19.408022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:19.408022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:19.466975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:19.468211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:19.545322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecf5dd-2701-4c02-b649-140d76921add admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:19.607117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 836/1649] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:19.651726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:19.654454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:19.748959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:19.749870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:19.750158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:19.750440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] PATH_INFO: `/v3/users/32048dc7b3d247df9b6ff0ae102e6c0c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:19.755615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32048dc7b3d247df9b6ff0ae102e6c0c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:19.755615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:19.862526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466ce84-3f5a-4d0f-99cc-12754d6a3bdb None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:19.886786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d6c3-0ab3-4cc1-a248-2275fcaa3322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:19.886786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d6c3-0ab3-4cc1-a248-2275fcaa3322 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:19.886786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d6c3-0ab3-4cc1-a248-2275fcaa3322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:19.886786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d6c3-0ab3-4cc1-a248-2275fcaa3322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:19.923466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7d6c3-0ab3-4cc1-a248-2275fcaa3322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:19.925135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7d6c3-0ab3-4cc1-a248-2275fcaa3322 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:19.955485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 837/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:20.160987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32048dc7b3d247df9b6ff0ae102e6c0c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:20.249229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cc155-ba7e-40e9-a5ce-fd8c1ba6de74 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:20.249710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cc155-ba7e-40e9-a5ce-fd8c1ba6de74 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:20.250132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cc155-ba7e-40e9-a5ce-fd8c1ba6de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:20.278408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32048dc7b3d247df9b6ff0ae102e6c0c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:20.282872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-057cc155-ba7e-40e9-a5ce-fd8c1ba6de74 None None] MFA Rules not processed for user `77c86031e3344ee5ba394b2f03ce13d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:20.284286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-057cc155-ba7e-40e9-a5ce-fd8c1ba6de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:20.305730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32048dc7b3d247df9b6ff0ae102e6c0c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:20.309194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32048dc7b3d247df9b6ff0ae102e6c0c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:20.327180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-640a27f9-c291-412e-81c9-0b71661ba680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32048dc7b3d247df9b6ff0ae102e6c0c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:20.350069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 814/1651] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:19 2022] DELETE /identity/v3/users/32048dc7b3d247df9b6ff0ae102e6c0c => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:20.376731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 838/1652] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:21.243702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:22.344666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:22.539816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7702a1-9bbd-4e74-9a75-dc63038d7b41 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:22.540333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7702a1-9bbd-4e74-9a75-dc63038d7b41 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:22.540778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7702a1-9bbd-4e74-9a75-dc63038d7b41 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:22.542979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 815/1653] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:22.579384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ce8f-3fae-4ca6-9227-5b0d47d9aaad None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:22.579857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ce8f-3fae-4ca6-9227-5b0d47d9aaad None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:22.579857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ce8f-3fae-4ca6-9227-5b0d47d9aaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:22.583636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7702a1-9bbd-4e74-9a75-dc63038d7b41 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:22.589218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0b7702a1-9bbd-4e74-9a75-dc63038d7b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:22.641673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7539ce8f-3fae-4ca6-9227-5b0d47d9aaad None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:22.655106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7539ce8f-3fae-4ca6-9227-5b0d47d9aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:22.799015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 839/1654] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:22.834476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd07f-bd6f-4472-9419-c67455d2ae70 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:22.840763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd07f-bd6f-4472-9419-c67455d2ae70 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:22.840763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd07f-bd6f-4472-9419-c67455d2ae70 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:22.840763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 840/1655] 10.222.0.49 () {54 vars in 961 bytes} [Thu Jul 21 10:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 10:46:22.852221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:22.852670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:22.853061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:22.872365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7702a1-9bbd-4e74-9a75-dc63038d7b41 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:22.884306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:22.887901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:22.887901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:22.887901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] PATH_INFO: `/v3/projects/e7864ffb9df540e7b74d29062e2afead` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:22.892375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7864ffb9df540e7b74d29062e2afead)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:22.896180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:22.900787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:22.911579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:22.950676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 841/1656] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Jul 21 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 21 10:46:22.967086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:22.981596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4506d-b952-49fd-9cc3-ceca358859ac None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:22.995041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:22.995713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:22.996109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:22.996437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.016828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:23.018464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:23.040718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 842/1657] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:23.126175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7864ffb9df540e7b74d29062e2afead', 'request_id': 'req-36c4b884-68dc-424c-9723-993aae3ea77a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.141106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7864ffb9df540e7b74d29062e2afead', 'request_id': 'req-36c4b884-68dc-424c-9723-993aae3ea77a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.248086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7864ffb9df540e7b74d29062e2afead', 'request_id': 'req-36c4b884-68dc-424c-9723-993aae3ea77a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.250712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:23.253248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:23.282836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] The token cache is being invalidate because project e7864ffb9df540e7b74d29062e2afead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:23.283130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.288298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36c4b884-68dc-424c-9723-993aae3ea77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.297971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 816/1658] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:22 2022] DELETE /identity/v3/projects/e7864ffb9df540e7b74d29062e2afead => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:23.300909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500370-b888-4876-a1d5-9b75248e60e4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.301200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500370-b888-4876-a1d5-9b75248e60e4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.301479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500370-b888-4876-a1d5-9b75248e60e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.303285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e35f-697f-4718-a443-e5bc3cd17271 service placement] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:23.360851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-91500370-b888-4876-a1d5-9b75248e60e4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:23.364035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-91500370-b888-4876-a1d5-9b75248e60e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:23.537125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:23.538081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.539014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.539281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] PATH_INFO: `/v3/projects/c37d893cb6de4d3593f66812278b348e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.545955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37d893cb6de4d3593f66812278b348e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:23.552420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:23.611463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 817/1659] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:23.619991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.620285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.620731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.652922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:23.654171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:23.669474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 818/1660] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:23.677204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:23.689658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86504-d873-4c75-8c14-c10dee7cb75f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:23.696527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:23.697414 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.698461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.698977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.699880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:23.700347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:23.702291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:23.716009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 819/1661] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:23.721371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:23.732903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4f75-6587-4145-9875-bae5d01b730a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:23.750104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37d893cb6de4d3593f66812278b348e', 'request_id': 'req-8dae1529-2d35-4302-8b31-0f573de84961'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.766709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37d893cb6de4d3593f66812278b348e', 'request_id': 'req-8dae1529-2d35-4302-8b31-0f573de84961'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.831753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:23.832712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.833206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.833633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.834481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:23.836794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:23.870323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37d893cb6de4d3593f66812278b348e', 'request_id': 'req-8dae1529-2d35-4302-8b31-0f573de84961'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.887786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] The token cache is being invalidate because project c37d893cb6de4d3593f66812278b348e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:23.888158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.889599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8dae1529-2d35-4302-8b31-0f573de84961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:23.892023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 843/1662] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:23 2022] DELETE /identity/v3/projects/c37d893cb6de4d3593f66812278b348e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:23.896885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2319-e32a-49b3-ba89-285824797ad9 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.897459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2319-e32a-49b3-ba89-285824797ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.901779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2319-e32a-49b3-ba89-285824797ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:23.937778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c8cb2319-e32a-49b3-ba89-285824797ad9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:23.942084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c8cb2319-e32a-49b3-ba89-285824797ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:23.965804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 844/1663] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:23.973973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:23.974436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:23.974889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.011438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:24.014145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:24.027019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:24.031757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 820/1664] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:23 2022] POST /identity/v3/projects => generated 365 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:24.037671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.039666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 845/1665] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:24.040186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:24.044977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.061795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1582c33-93ca-42df-a32b-599545fc5219 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.203698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.204652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.205090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.205514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.206731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:24.207060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0fc02-4c72-4f05-99eb-b90201b28ca3 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.207679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.210036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.225567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.226513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.226975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.229790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.230983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.238486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.250196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 846/1666] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:46:24.273107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.288692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ee89b-0291-41f3-95e2-892342c0f9e2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.304101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.304343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.304472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.304950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.305704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.327064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.436233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 847/1667] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:24 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:46:24.439609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.447756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 821/1668] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:24 2022] POST /identity/v3/users => generated 283 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:46:24.451416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.519334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d30afc-38fe-48cd-8d8e-412c2b538410 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.553282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:24.615638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f2fd-830b-4285-a204-aeed1d5059f9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.632498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.633214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.633508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.633817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.641002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.641002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.648630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.649341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.649803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.650717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.652490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.654284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.680579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 822/1669] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:24.685389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.710862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab428d-1df9-48d7-b047-9fa9d595cd23 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.728579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.732493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.732493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.732493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.732493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.732493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.756637 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 823/1670] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:24.758026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.783380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedcdf5-8d2d-45e6-b497-75962b6e835c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.798803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5a11-53c8-41ea-959f-abb28b6f1061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.800114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5a11-53c8-41ea-959f-abb28b6f1061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.800550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5a11-53c8-41ea-959f-abb28b6f1061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.800967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5a11-53c8-41ea-959f-abb28b6f1061 admin admin] PATH_INFO: `/v3/projects/1d097e566a4f464494548f232b5a9c38/users/feb949140b024ee2bc77c9ab572bfab5/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.811017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 848/1671] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:24 2022] POST /identity/v3/users => generated 283 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:46:24.812026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.830645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba15a7-0732-432c-a628-fd887ea6c92a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.836956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5a11-53c8-41ea-959f-abb28b6f1061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d097e566a4f464494548f232b5a9c38, user_id=feb949140b024ee2bc77c9ab572bfab5, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.842743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5a11-53c8-41ea-959f-abb28b6f1061 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.857345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.858060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.858349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.858630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.859471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.861105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.883210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 849/1672] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:24.884167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:24.909859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4009d-3eb3-467d-8e29-8750ff9d5e8c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:24.923620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:24.930346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.930903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.931345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.932299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:24.934560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:24.952060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 824/1673] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:24 2022] PUT /identity/v3/projects/1d097e566a4f464494548f232b5a9c38/users/feb949140b024ee2bc77c9ab572bfab5/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:24.954329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:24.954329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:24.954516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:24.986878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 850/1674] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:24.992436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:25.018130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] MFA Rules not processed for user `feb949140b024ee2bc77c9ab572bfab5`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:25.019426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:25.019891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f0aa-0196-469b-a6d4-fc55b645d75e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:25.133663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11145bb-e653-404f-9bcb-beb4d7a36574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:25.135087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11145bb-e653-404f-9bcb-beb4d7a36574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:25.136086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11145bb-e653-404f-9bcb-beb4d7a36574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:25.136560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11145bb-e653-404f-9bcb-beb4d7a36574 admin admin] PATH_INFO: `/v3/projects/61d766114791403e98f89ebe6ae51b79/users/192a1719efda4fba8423f25f33f07cb4/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:25.179544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11145bb-e653-404f-9bcb-beb4d7a36574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d766114791403e98f89ebe6ae51b79, user_id=192a1719efda4fba8423f25f33f07cb4, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:25.185806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11145bb-e653-404f-9bcb-beb4d7a36574 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:25.196164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:25.201198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 825/1675] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:25.205483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:25.230736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24a6b-f22c-4e13-b6a9-acf1903fe98e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:25.241338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:25.242176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:25.242465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:25.242772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:25.243481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:25.245491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:25.309530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 851/1676] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:24 2022] PUT /identity/v3/projects/61d766114791403e98f89ebe6ae51b79/users/192a1719efda4fba8423f25f33f07cb4/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:25.325222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875159b-cef3-46ab-a304-643089109995 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:25.325524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875159b-cef3-46ab-a304-643089109995 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:25.325839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875159b-cef3-46ab-a304-643089109995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:25.374240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 826/1677] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:25 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:25.376165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:25.410888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3875159b-cef3-46ab-a304-643089109995 None None] MFA Rules not processed for user `192a1719efda4fba8423f25f33f07cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:25.412140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3875159b-cef3-46ab-a304-643089109995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:25.567753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 852/1678] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:25.572417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875159b-cef3-46ab-a304-643089109995 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:25.573867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3875159b-cef3-46ab-a304-643089109995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:25.597858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918f99-7e04-403f-bbbd-6175fa058595 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:25.612141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875159b-cef3-46ab-a304-643089109995 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:25.613054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:25.614479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:25.615735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:25.616525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:25.617834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:25.624550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:25.637072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:25.637072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:25.637072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:25.637072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] PATH_INFO: `/v3/users/18afdb5efe8647ffacf22debc24b44ba` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:25.637760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18afdb5efe8647ffacf22debc24b44ba)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:25.641236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:25.762993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 827/1679] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:25 2022] POST /identity/v3/users => generated 289 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:25.763911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:25.800619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb608b-f150-463c-90f9-03b3f4b606cb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:25.808325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:25.809558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:25.810001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:25.810632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:25.811602 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:25.815004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:25.934375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18afdb5efe8647ffacf22debc24b44ba'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:26.024018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 828/1680] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:25 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:26.027604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.055082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18afdb5efe8647ffacf22debc24b44ba'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:26.055897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18afdb5efe8647ffacf22debc24b44ba'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:26.074252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18afdb5efe8647ffacf22debc24b44ba'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:26.100445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18afdb5efe8647ffacf22debc24b44ba'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:26.129857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 853/1681] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:25 2022] DELETE /identity/v3/users/18afdb5efe8647ffacf22debc24b44ba => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:26.131213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.141553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:26.221860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c358e2-82ca-428f-977a-da65a2207487 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.314390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca6569-cbda-4e0b-8327-b528939c170b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.329251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.329954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.330427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.330737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.331462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.333422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.359422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.361623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.361623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.361623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.362364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.364099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.393228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 829/1682] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:26.397841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.404206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:26.452225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc2f5-eb1f-41d8-b5fa-024fb2d2fefb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.468983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.470030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.470461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.470881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] PATH_INFO: `/v3/projects/fcb5b5c10e644af887794302b9abdabb/users/9708d7a697224f9d9c1e9d42760aacc2/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.479569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 854/1683] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:26 2022] POST /identity/v3/users => generated 289 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:26.479569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.499219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc029b-5baa-4652-bbd2-f8e2afe39c5f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.501362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb5b5c10e644af887794302b9abdabb, user_id=9708d7a697224f9d9c1e9d42760aacc2, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.504392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.511806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.512521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.513427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.513427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.513827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.516025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.541481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 855/1684] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:26.549536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.571735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30474-4c26-41e9-b390-0631d544f795 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.587439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.588561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.588855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.589713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] PATH_INFO: `/v3/projects/071e6b7f5e1243229c3afe079539c625/users/37289496ce8545589b5f64c4e466d2f9/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.618719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071e6b7f5e1243229c3afe079539c625, user_id=37289496ce8545589b5f64c4e466d2f9, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.624506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.659479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 830/1685] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:26 2022] PUT /identity/v3/projects/fcb5b5c10e644af887794302b9abdabb/users/9708d7a697224f9d9c1e9d42760aacc2/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:26.664226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.736439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 856/1686] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:26 2022] PUT /identity/v3/projects/071e6b7f5e1243229c3afe079539c625/users/37289496ce8545589b5f64c4e466d2f9/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:26.737594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.811802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b3cb4-ebf8-4565-80e5-bd88dcec3278 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.896424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef113-6541-41ad-917b-84dd2b5b7d14 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.912460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.913370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.913671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.914059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.914849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.916483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.955810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 857/1687] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:26.959601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:26.975546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.976324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.976804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.977097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.978324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:26.980418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:26.984387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbe547-bb16-4abb-8a4f-ac4e8ba71bdd admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:26.992021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1628b-4f20-46fa-8e83-2f9bfb2c04ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:26.996888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1628b-4f20-46fa-8e83-2f9bfb2c04ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:26.996888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1628b-4f20-46fa-8e83-2f9bfb2c04ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:26.996888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1628b-4f20-46fa-8e83-2f9bfb2c04ce admin admin] PATH_INFO: `/v3/projects/071e6b7f5e1243229c3afe079539c625/users/37289496ce8545589b5f64c4e466d2f9/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:26.999431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1628b-4f20-46fa-8e83-2f9bfb2c04ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=071e6b7f5e1243229c3afe079539c625, user_id=37289496ce8545589b5f64c4e466d2f9, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:27.005548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 831/1688] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:27.007145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:27.013819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1628b-4f20-46fa-8e83-2f9bfb2c04ce admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:27.027663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 858/1689] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:26 2022] PUT /identity/v3/projects/071e6b7f5e1243229c3afe079539c625/users/37289496ce8545589b5f64c4e466d2f9/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:27.037326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21af64-ec4b-4a15-8beb-983af495905a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:27.039402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70bade-3167-461d-bc91-0aaa286a437c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:27.041985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70bade-3167-461d-bc91-0aaa286a437c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:27.059396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70bade-3167-461d-bc91-0aaa286a437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:27.101700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1a70bade-3167-461d-bc91-0aaa286a437c None None] MFA Rules not processed for user `37289496ce8545589b5f64c4e466d2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:27.103252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1a70bade-3167-461d-bc91-0aaa286a437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:27.171141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:27.173723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:27.174027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:27.174309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] PATH_INFO: `/v3/projects/fcb5b5c10e644af887794302b9abdabb/users/9708d7a697224f9d9c1e9d42760aacc2/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:27.178651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb5b5c10e644af887794302b9abdabb, user_id=9708d7a697224f9d9c1e9d42760aacc2, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:27.185019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:27.209649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 832/1690] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:27 2022] PUT /identity/v3/projects/fcb5b5c10e644af887794302b9abdabb/users/9708d7a697224f9d9c1e9d42760aacc2/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:27.228156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:27.232237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:27.279914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 859/1691] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:27.281506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:27.285060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:27.285377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:27.348437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] MFA Rules not processed for user `9708d7a697224f9d9c1e9d42760aacc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:27.350873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:27.417020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eb8d5-80e1-48a7-a72a-e99bd7cf85fc admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:27.440248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:27.442030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:27.444619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:27.462290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] PATH_INFO: `/v3/projects/65eddd2fb2d141dda930feaf8f372172` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:27.462290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65eddd2fb2d141dda930feaf8f372172)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:27.462290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:27.567010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 860/1692] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:27.569735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:27.571441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:27.689934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65eddd2fb2d141dda930feaf8f372172', 'request_id': 'req-728e0700-c67b-4842-bdd4-a8451154447f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:27.700863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65eddd2fb2d141dda930feaf8f372172', 'request_id': 'req-728e0700-c67b-4842-bdd4-a8451154447f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:27.705900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73110c64-0e53-4cca-afbd-4549434bdc88 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:27.808319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65eddd2fb2d141dda930feaf8f372172', 'request_id': 'req-728e0700-c67b-4842-bdd4-a8451154447f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:27.835153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] The token cache is being invalidate because project 65eddd2fb2d141dda930feaf8f372172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:27.835448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:27.840096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:27.842911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 833/1693] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:27 2022] DELETE /identity/v3/projects/65eddd2fb2d141dda930feaf8f372172 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:27.848422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:27.848422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:27.896711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:27.907087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:27.907943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:27.908092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:27.908510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:27.914841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:27.975860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e0700-c67b-4842-bdd4-a8451154447f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:27.985884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:27.987197 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:27.987683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:27.988138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:27.998597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:28.060378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:28.062367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:28.095900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 861/1694] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:28.096987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:28.098503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:28.138479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:28.140453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:28.159577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 834/1695] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:28.228864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b12c9-3ec5-468a-a4ec-41d6041ade8b service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:28.236256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:28.237189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:28.237564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:28.238649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] PATH_INFO: `/v3/users/77c86031e3344ee5ba394b2f03ce13d3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:28.240494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c86031e3344ee5ba394b2f03ce13d3)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:28.243244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:28.321049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:28.322928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:28.363522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05db69-c8cd-475c-98ff-304c417ad00e service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:28.382721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:28.390646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:28.392027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:28.392900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:28.393388 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] PATH_INFO: `/v3/users/8f5546b16c9f4e8686fd960d0c4120b4` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:28.397540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5546b16c9f4e8686fd960d0c4120b4)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:28.406824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:28.579795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c86031e3344ee5ba394b2f03ce13d3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.663820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5546b16c9f4e8686fd960d0c4120b4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.730722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c86031e3344ee5ba394b2f03ce13d3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.731863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c86031e3344ee5ba394b2f03ce13d3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.741565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c86031e3344ee5ba394b2f03ce13d3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.797525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c86031e3344ee5ba394b2f03ce13d3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.814214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 862/1696] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:28 2022] DELETE /identity/v3/users/77c86031e3344ee5ba394b2f03ce13d3 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:28.815174 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:28.819849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:28.913184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5546b16c9f4e8686fd960d0c4120b4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.954461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5546b16c9f4e8686fd960d0c4120b4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.959181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5546b16c9f4e8686fd960d0c4120b4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.981386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5546b16c9f4e8686fd960d0c4120b4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:28.988987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 835/1697] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:28 2022] DELETE /identity/v3/users/8f5546b16c9f4e8686fd960d0c4120b4 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:28.992786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:29.003916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.050570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a72a1-3ea5-4010-81a7-15805311c1d2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:29.141848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb8a8-e8f6-4248-824c-b16a35ad1d69 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:29.146030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:29.146743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.147000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.147278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.158077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.202552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:29.203915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.204406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.204842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.209224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.295424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:29.298046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24675c54-7584-464e-abda-06d81cec4315 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:29.312224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 836/1698] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:29.313676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.314054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.314840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.334904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:29.335721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.371222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:29.372858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1887c3-347e-4f73-acac-6b715dcf3ad7 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:29.379336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:29.393843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 863/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:29.395538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546494-9e76-469f-9870-ac91c78260e6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.395538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546494-9e76-469f-9870-ac91c78260e6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.395839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546494-9e76-469f-9870-ac91c78260e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.453028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7a546494-9e76-469f-9870-ac91c78260e6 None None] MFA Rules not processed for user `12305af61a2941fe81075b7e6609c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:29.454379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7a546494-9e76-469f-9870-ac91c78260e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.463058 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 837/1700] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:29.483944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:29.489111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.626854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 864/1701] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:29.637772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.638257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.638716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.659449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f5b15-a7b1-476b-abe4-b99b795b8867 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:29.672932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bbe6d-b0b5-454b-8bf6-ff140f07fb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:29.673962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bbe6d-b0b5-454b-8bf6-ff140f07fb25 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.679728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bbe6d-b0b5-454b-8bf6-ff140f07fb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.680027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bbe6d-b0b5-454b-8bf6-ff140f07fb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.708948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bbe6d-b0b5-454b-8bf6-ff140f07fb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:29.710828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bbe6d-b0b5-454b-8bf6-ff140f07fb25 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:29.720451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] MFA Rules not processed for user `56083498939444d3b06f6282ed22d253`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:29.721947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.738293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 838/1702] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:29.742029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.742029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.744954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.794041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] MFA Rules not processed for user `12305af61a2941fe81075b7e6609c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:29.795525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.824224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 839/1703] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:29.833425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:29.835492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.910027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 865/1704] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:29.931091 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:29.933458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:29.959649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c366d7-e34b-45ee-97ba-b068b2b65677 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:29.967297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:29.968090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:29.968473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:29.968845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:29.980991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:29.984143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:30.000920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 840/1705] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:30.002066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:30.003697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:30.031229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a7c67-2d83-4123-9998-9f56212dddb2 service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:30.041648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:30.044837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:30.049005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:30.050413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:30.050825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] PATH_INFO: `/v3/projects/a093dbaad47a4a27a7358b8222d83af2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:30.056407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a093dbaad47a4a27a7358b8222d83af2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:30.064342 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:30.271347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb343-cffa-4d6f-a374-f0f5e5f68cc4 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:30.287962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc3654-3231-4518-bd74-4ed98e078f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:30.306764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3654-3231-4518-bd74-4ed98e078f9a service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:30.307367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3654-3231-4518-bd74-4ed98e078f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:30.307915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3654-3231-4518-bd74-4ed98e078f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:30.330917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc3654-3231-4518-bd74-4ed98e078f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:30.330917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc3654-3231-4518-bd74-4ed98e078f9a service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:30.363610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a093dbaad47a4a27a7358b8222d83af2', 'request_id': 'req-625c7fa7-ccd6-419f-841c-054318571626'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:30.368928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 866/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:30.373888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a093dbaad47a4a27a7358b8222d83af2', 'request_id': 'req-625c7fa7-ccd6-419f-841c-054318571626'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:30.505220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a093dbaad47a4a27a7358b8222d83af2', 'request_id': 'req-625c7fa7-ccd6-419f-841c-054318571626'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:30.528591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] The token cache is being invalidate because project a093dbaad47a4a27a7358b8222d83af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:30.528897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:30.530850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-625c7fa7-ccd6-419f-841c-054318571626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:30.534395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 841/1707] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:30 2022] DELETE /identity/v3/projects/a093dbaad47a4a27a7358b8222d83af2 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:30.539427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:30.558112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:30.558112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:30.581688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:30.583051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:30.750220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:30.787111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 867/1708] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:30.795297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:30.795652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:30.796002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:30.834977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:30.838366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:30.864740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 842/1709] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:30.869430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:30.881162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb16a-5aec-454b-873f-396da43027b0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:30.908984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:30.909693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:30.909979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:30.910247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:30.914433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:30.915716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:30.918299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4f9e6-9382-4e25-b676-c02a5759fe70 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:30.937183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 868/1710] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:46:30.942587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:30.957234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc743-6da8-43c6-ae4d-f0a97e20f246 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:30.969731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:30.970471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:30.970775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:30.971051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:30.971808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:30.976312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:31.065523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5967c7-f933-4b8c-9a5a-b9830c43565d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.065523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5967c7-f933-4b8c-9a5a-b9830c43565d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.065523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5967c7-f933-4b8c-9a5a-b9830c43565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.114153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fe5967c7-f933-4b8c-9a5a-b9830c43565d None None] MFA Rules not processed for user `d1282d4187a54299836bb6b4300d15c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:31.115667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fe5967c7-f933-4b8c-9a5a-b9830c43565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:31.130894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 843/1711] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:30 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:31.136001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:31.360742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72efabb-6f2f-41c1-99c4-cecf244bb098 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:31.361665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 869/1712] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:31.363231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599b90-1d77-4fb0-8c18-0ea61e4cb487 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.370579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599b90-1d77-4fb0-8c18-0ea61e4cb487 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.370579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599b90-1d77-4fb0-8c18-0ea61e4cb487 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.370579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 870/1713] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 21 10:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:31.371377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599b90-1d77-4fb0-8c18-0ea61e4cb487 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:31.373284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9c599b90-1d77-4fb0-8c18-0ea61e4cb487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:31.380043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f9ce-e408-4afa-bab9-9a9c6b4547fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:31.380740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f9ce-e408-4afa-bab9-9a9c6b4547fc admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.381025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f9ce-e408-4afa-bab9-9a9c6b4547fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.381304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f9ce-e408-4afa-bab9-9a9c6b4547fc admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.382056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665f9ce-e408-4afa-bab9-9a9c6b4547fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:31.385061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665f9ce-e408-4afa-bab9-9a9c6b4547fc admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:31.402846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:31.536277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 844/1714] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:31 2022] POST /identity/v3/users => generated 290 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:31.537742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.539632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.539929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.609919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:31.611701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:31.624360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599b90-1d77-4fb0-8c18-0ea61e4cb487 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:31.631310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef9e00-9b5c-46b6-9170-a3c745ba866d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:31.632067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef9e00-9b5c-46b6-9170-a3c745ba866d service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.632539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef9e00-9b5c-46b6-9170-a3c745ba866d service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.632882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef9e00-9b5c-46b6-9170-a3c745ba866d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.653470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef9e00-9b5c-46b6-9170-a3c745ba866d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:31.655703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef9e00-9b5c-46b6-9170-a3c745ba866d service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:31.694037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 871/1715] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:31.697985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.702603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.702951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.704285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:31.737621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 845/1716] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:31.740484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:31.772814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dc117-6c56-46bd-8fbc-138c72e4d137 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:31.787428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] MFA Rules not processed for user `5c6586cbd05e4b49b8ff44b09bc7d51f`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:31.790213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:31.794775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:31.799243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.799243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.799243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.799243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:31.801740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:31.832497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 846/1717] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:31.834449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:31.842443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:31.871925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4adf8-c488-48cb-898e-0523e4a1c7ae admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:31.892091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:31.893007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:31.893288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:31.893559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] PATH_INFO: `/v3/projects/c4f9408b30ad46dd96d7fa679ffcee00` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:31.895397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f9408b30ad46dd96d7fa679ffcee00)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:31.911408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:31.986324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 872/1718] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:31.987934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:31.990206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:32.014851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab64ad8-df73-4217-a2ee-0612e4e22c69 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:32.062354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:32.066391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:32.068273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:32.069149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:32.100348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:32.110730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:32.141491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 873/1719] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:32.148337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:32.179058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182232f8-81cc-4379-9311-6f8dc28cf7fe service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:32.184972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f9408b30ad46dd96d7fa679ffcee00', 'request_id': 'req-ee40fe84-2bbe-499d-a645-760be77e0774'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:32.217699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f9408b30ad46dd96d7fa679ffcee00', 'request_id': 'req-ee40fe84-2bbe-499d-a645-760be77e0774'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:32.342142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de988fe9-977d-48ef-ad69-92ede93d672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:32.342142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988fe9-977d-48ef-ad69-92ede93d672b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:32.342142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988fe9-977d-48ef-ad69-92ede93d672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:32.342142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988fe9-977d-48ef-ad69-92ede93d672b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:32.343024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de988fe9-977d-48ef-ad69-92ede93d672b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:32.343024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de988fe9-977d-48ef-ad69-92ede93d672b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:32.361237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f9408b30ad46dd96d7fa679ffcee00', 'request_id': 'req-ee40fe84-2bbe-499d-a645-760be77e0774'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:32.388822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] The token cache is being invalidate because project c4f9408b30ad46dd96d7fa679ffcee00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:32.389105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:32.389927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:32.403743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 874/1721] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:32.404375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 847/1721] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:31 2022] DELETE /identity/v3/projects/c4f9408b30ad46dd96d7fa679ffcee00 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:32.405366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:32.406308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e585-e14d-41d7-a4e2-6f584e935f25 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:32.411248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e585-e14d-41d7-a4e2-6f584e935f25 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:32.411702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e585-e14d-41d7-a4e2-6f584e935f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:32.419348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:32.493520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fe84-2bbe-499d-a645-760be77e0774 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:32.494737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4680e585-e14d-41d7-a4e2-6f584e935f25 None None] MFA Rules not processed for user `5c6586cbd05e4b49b8ff44b09bc7d51f`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:32.496054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4680e585-e14d-41d7-a4e2-6f584e935f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:32.517980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db8080-23e8-4995-aeee-68dffcdc5c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:32.519037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db8080-23e8-4995-aeee-68dffcdc5c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:32.519381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db8080-23e8-4995-aeee-68dffcdc5c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:32.519853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db8080-23e8-4995-aeee-68dffcdc5c72 admin admin] PATH_INFO: `/v3/projects/51c8d4eff8b64dcd9680bce9bf435e30/users/645654d902764e7288237138159ee936/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:32.587857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db8080-23e8-4995-aeee-68dffcdc5c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c8d4eff8b64dcd9680bce9bf435e30, user_id=645654d902764e7288237138159ee936, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:32.608788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db8080-23e8-4995-aeee-68dffcdc5c72 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:32.667976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 875/1722] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:32.669356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:32.669656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:32.669937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:32.719228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:32.720767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:32.743610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 876/1723] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:32.748756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:32.748756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:32.765440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 848/1724] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:32 2022] PUT /identity/v3/projects/51c8d4eff8b64dcd9680bce9bf435e30/users/645654d902764e7288237138159ee936/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:32.789244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab3eb7-913e-4314-95d2-827071a73eb2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:32.790232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab3eb7-913e-4314-95d2-827071a73eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:32.792412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab3eb7-913e-4314-95d2-827071a73eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:32.874308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b8ab3eb7-913e-4314-95d2-827071a73eb2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:32.880340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:32.880518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b8ab3eb7-913e-4314-95d2-827071a73eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:32.894240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca589-ccc1-46f7-bf5c-3899da200980 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:33.083275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:33.084110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:33.084449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:33.084727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:33.088207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:33.131594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 849/1725] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:33.136214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:33.137948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:33.142542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:33.206496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:33.208631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:33.220235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 877/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:33.221521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:33.222593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] MFA Rules not processed for user `645654d902764e7288237138159ee936`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:33.224204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:33.238867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8e2fc-26fa-4e83-a1da-3cfa613650cf service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:33.248927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:33.249677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:33.250141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:33.250560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:33.251464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:33.251930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:33.253761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:33.331878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 878/1727] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:33.334775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:33.379478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3f1c2-b44b-45a4-8fb7-806f9c28f11a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:33.407473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68928f1f-2304-4492-9101-151648042538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:33.411212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928f1f-2304-4492-9101-151648042538 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:33.411650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928f1f-2304-4492-9101-151648042538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:33.411895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928f1f-2304-4492-9101-151648042538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:33.413781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68928f1f-2304-4492-9101-151648042538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:33.416308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68928f1f-2304-4492-9101-151648042538 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:33.499605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 850/1728] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:33.507757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:33.542493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242e3c-010e-4a2c-99fb-513393f7362c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:33.555411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:33.556700 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:33.556993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:33.557296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:33.565619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:33.568619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:33.573631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 879/1729] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:33 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:33.582320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68928f1f-2304-4492-9101-151648042538 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:33.747174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 851/1730] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:33 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:33.749525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:33.767026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68928f1f-2304-4492-9101-151648042538 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:33.773125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:33.962152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:33.962947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:33.965708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:33.966019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:33.973107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:33.980220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.039038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:34.060916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ec64-c025-414e-b275-d67c3913461d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.082564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.086324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.087507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.087812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.091024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:34.105553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.107718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6335159-9305-4885-a4aa-8b012a42911a service placement] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.142887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 880/1731] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:33 2022] POST /identity/v3/users => generated 288 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:34.143077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:34.143873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 852/1732] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:34.148405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.152310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.152679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.178364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b107e-0ec7-4d45-8055-4878b760ccd4 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.201916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1293-ae01-4555-a566-3b13099b5c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.203137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1293-ae01-4555-a566-3b13099b5c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.203137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1293-ae01-4555-a566-3b13099b5c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.203421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1293-ae01-4555-a566-3b13099b5c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.204189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1293-ae01-4555-a566-3b13099b5c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.207769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1293-ae01-4555-a566-3b13099b5c9c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.226516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] MFA Rules not processed for user `12305af61a2941fe81075b7e6609c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:34.230677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:34.337335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 881/1733] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:34 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:34.339748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39356e-0a6e-4cad-97a4-c22e6cb029a4 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.344258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39356e-0a6e-4cad-97a4-c22e6cb029a4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.344752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39356e-0a6e-4cad-97a4-c22e6cb029a4 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.351813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 882/1734] 10.222.0.49 () {54 vars in 912 bytes} [Thu Jul 21 10:46:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:34.354976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39356e-0a6e-4cad-97a4-c22e6cb029a4 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:34.391750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 853/1735] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:34.395869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:34.400246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39356e-0a6e-4cad-97a4-c22e6cb029a4 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.406670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912cdb4-4920-4bd0-bc09-9fbcf6734826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.407653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912cdb4-4920-4bd0-bc09-9fbcf6734826 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.408564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912cdb4-4920-4bd0-bc09-9fbcf6734826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.409440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912cdb4-4920-4bd0-bc09-9fbcf6734826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.410409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912cdb4-4920-4bd0-bc09-9fbcf6734826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.412900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912cdb4-4920-4bd0-bc09-9fbcf6734826 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.434989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4404e46-12bc-478e-a428-a16b3c50a053 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.452440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 883/1736] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:34.454335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.464883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.464883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.479001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.483029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.483334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.483543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.484319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.496644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.497828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:34.499234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:34.548791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 854/1737] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:34.551172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:34.582577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3c351-2c7e-44e2-9ae4-62a0fd3cae7f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.600294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.602406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.602715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.603011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.607184 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.612620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.617880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:34.660050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 855/1738] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:34.660050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:34.661049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 884/1739] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:34.661927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:34.668712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:34.695534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935309b-7690-450c-b9a7-7fbf1116d407 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.702028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22b23-622a-4e71-9e64-d75f5f6f7e35 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:34.725954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.730056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:34.730957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.731363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.731473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:34.731656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] PATH_INFO: `/v3/users/192a1719efda4fba8423f25f33f07cb4` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.731757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:34.731987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] PATH_INFO: `/v3/projects/8bfaa8a521c942e39207a6ebe423fed1/users/d45c0097abcd4d30a547ca88ee8281b9/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:34.740681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192a1719efda4fba8423f25f33f07cb4)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.752207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.761639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfaa8a521c942e39207a6ebe423fed1, user_id=d45c0097abcd4d30a547ca88ee8281b9, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:34.761989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:34.871978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 856/1740] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:34 2022] PUT /identity/v3/projects/8bfaa8a521c942e39207a6ebe423fed1/users/d45c0097abcd4d30a547ca88ee8281b9/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:34.875604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:35.060864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192a1719efda4fba8423f25f33f07cb4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:35.154165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc9473-7333-4ee5-ad52-92ab1060cec5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:35.158359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192a1719efda4fba8423f25f33f07cb4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:35.159258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192a1719efda4fba8423f25f33f07cb4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:35.170542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192a1719efda4fba8423f25f33f07cb4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:35.197763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192a1719efda4fba8423f25f33f07cb4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:35.200479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:35.201450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:35.201736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:35.202016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] PATH_INFO: `/v3/projects/d54d970431494d76b115f69870d418ae/users/d309d18d3323476f9b35f4319594c532/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:35.227483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 885/1741] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:34 2022] DELETE /identity/v3/users/192a1719efda4fba8423f25f33f07cb4 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:35.230127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:35.237101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:35.244071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54d970431494d76b115f69870d418ae, user_id=d309d18d3323476f9b35f4319594c532, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:35.259677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:35.379413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 857/1742] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:34 2022] PUT /identity/v3/projects/d54d970431494d76b115f69870d418ae/users/d309d18d3323476f9b35f4319594c532/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:35.380729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:35.391868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:35.458965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba482b0-211f-4584-9df9-d8a0ba3f40f7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:35.626247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97b1ca-99ef-40c4-945a-7f012401e2a5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:35.658164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3606b-3b26-4ada-808a-d0c73edf2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:35.662359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:35.663646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3606b-3b26-4ada-808a-d0c73edf2802 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:35.664992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:35.665553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3606b-3b26-4ada-808a-d0c73edf2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:35.666319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3606b-3b26-4ada-808a-d0c73edf2802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:35.669266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:35.669734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:35.670101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3606b-3b26-4ada-808a-d0c73edf2802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:35.672677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3606b-3b26-4ada-808a-d0c73edf2802 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:35.676147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:35.720344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:35.725788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2890215-5555-432c-9070-24331e17a3f5 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:35.739605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 858/1743] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:35.747340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:35.749103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:35.749612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:35.757900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 886/1744] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:35.765082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc529521-2389-45d8-a65a-929d1983cb11 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:35.773114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc529521-2389-45d8-a65a-929d1983cb11 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:35.773114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc529521-2389-45d8-a65a-929d1983cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:35.815885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:35.819472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:35.841744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 859/1745] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:35.847667 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:35.852108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-cc529521-2389-45d8-a65a-929d1983cb11 None None] MFA Rules not processed for user `d309d18d3323476f9b35f4319594c532`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:35.853339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cc529521-2389-45d8-a65a-929d1983cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:35.915019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c9f1d-2c25-4448-977d-6adb3cb6c7dc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:35.937013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:35.942746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:35.943125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:35.944624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] PATH_INFO: `/v3/projects/8bfaa8a521c942e39207a6ebe423fed1/users/d45c0097abcd4d30a547ca88ee8281b9/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:35.952965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfaa8a521c942e39207a6ebe423fed1, user_id=d45c0097abcd4d30a547ca88ee8281b9, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:35.963128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:36.013327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 860/1746] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:35 2022] PUT /identity/v3/projects/8bfaa8a521c942e39207a6ebe423fed1/users/d45c0097abcd4d30a547ca88ee8281b9/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:36.024581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:36.029170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 887/1747] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:36.031768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:36.032236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:36.032678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:36.187316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] MFA Rules not processed for user `d45c0097abcd4d30a547ca88ee8281b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:36.189763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:36.263500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd3e10-a84f-4d47-9ea5-45516dbf0be0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:36.282351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:36.283192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:36.284378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:36.284657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:36.489993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:36.537641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:36.537641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:36.561518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 861/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:36.562888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:36.570976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:36.571359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 888/1749] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 541 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:36.580247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:36.582239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:36.762233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcd27b-84bc-4889-b207-3dd09696f2f1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:36.777836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:36.779208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:36.779737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:36.780207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:36.813433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:36.817661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:36.833665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 889/1750] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:36.836448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcb45-73c2-4175-86b4-70a13676d931 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:36.851566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6143e-d8ba-4790-ae73-b8c8678b7e1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:36.852241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6143e-d8ba-4790-ae73-b8c8678b7e1d service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:36.852526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6143e-d8ba-4790-ae73-b8c8678b7e1d service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:36.852925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6143e-d8ba-4790-ae73-b8c8678b7e1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:37.016993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6143e-d8ba-4790-ae73-b8c8678b7e1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:37.039699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6143e-d8ba-4790-ae73-b8c8678b7e1d service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:37.103622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 862/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:37.277145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:37.278819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:37.297555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8532-da1f-4d28-9179-4c5b059ac0b0 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:37.332746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:37.333421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:37.333708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:37.333983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:37.345736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:37.488036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:37.503268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:37.505888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:37.519629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 890/1752] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:37.598149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:37.603379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:37.603926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:37.660816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] MFA Rules not processed for user `56083498939444d3b06f6282ed22d253`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:37.662497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:37.696393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:37.897983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:37.899585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:37.910265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 863/1753] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:37.931402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182e43c-0f98-476d-8342-bc8556b1a733 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:37.957037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:37.959773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:37.964553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:37.967923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] PATH_INFO: `/v3/users/d309d18d3323476f9b35f4319594c532` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:37.974886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d309d18d3323476f9b35f4319594c532)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:37.980846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:38.137213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:38.138767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:38.172832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeabba-220e-433c-b4f7-6e803a5ab114 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:38.178016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:38.187954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:38.187954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:38.187954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] PATH_INFO: `/v3/projects/61d766114791403e98f89ebe6ae51b79` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:38.187954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d766114791403e98f89ebe6ae51b79)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:38.187954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:38.450505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd309d18d3323476f9b35f4319594c532'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.474254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d766114791403e98f89ebe6ae51b79', 'request_id': 'req-0f71dbb0-d796-4a78-aa16-795aeea4b374'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.492819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d766114791403e98f89ebe6ae51b79', 'request_id': 'req-0f71dbb0-d796-4a78-aa16-795aeea4b374'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.581340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd309d18d3323476f9b35f4319594c532'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.582258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd309d18d3323476f9b35f4319594c532'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.584226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:38.596191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd309d18d3323476f9b35f4319594c532'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.614760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-08dbf821-8e2d-42a5-b8f7-b6b90499de55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd309d18d3323476f9b35f4319594c532'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.622152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 891/1754] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:37 2022] DELETE /identity/v3/users/d309d18d3323476f9b35f4319594c532 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:38.628065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:38.628634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:38.628921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:38.658111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:38.659524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:38.676491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d766114791403e98f89ebe6ae51b79', 'request_id': 'req-0f71dbb0-d796-4a78-aa16-795aeea4b374'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.714212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] The token cache is being invalidate because project 61d766114791403e98f89ebe6ae51b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:38.714826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.715744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:38.719500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 864/1755] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:38 2022] DELETE /identity/v3/projects/61d766114791403e98f89ebe6ae51b79 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:38.724923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:38.730531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:38.825290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 892/1756] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:38.838406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:38.840790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:38.876726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:38.891670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71dbb0-d796-4a78-aa16-795aeea4b374 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:38.896716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:38.897618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:38.897902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:38.898180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] PATH_INFO: `/v3/users/37289496ce8545589b5f64c4e466d2f9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:38.899578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37289496ce8545589b5f64c4e466d2f9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:38.902206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:38.965620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a68c30-4811-4c30-acdd-117d5da1ccf7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:38.970369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7ca5-4cf7-46cf-9771-e74897108872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:38.971272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7ca5-4cf7-46cf-9771-e74897108872 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:38.971564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7ca5-4cf7-46cf-9771-e74897108872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:38.971896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7ca5-4cf7-46cf-9771-e74897108872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:38.995609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b7ca5-4cf7-46cf-9771-e74897108872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:38.996952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b7ca5-4cf7-46cf-9771-e74897108872 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:39.009655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 893/1757] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:39.127403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37289496ce8545589b5f64c4e466d2f9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:39.227101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37289496ce8545589b5f64c4e466d2f9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:39.246493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4bd8-a008-4d76-b173-744750899da1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:39.246493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4bd8-a008-4d76-b173-744750899da1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:39.246493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4bd8-a008-4d76-b173-744750899da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:39.253065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37289496ce8545589b5f64c4e466d2f9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:39.254074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37289496ce8545589b5f64c4e466d2f9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:39.276355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-948b4bd8-a008-4d76-b173-744750899da1 None None] MFA Rules not processed for user `d1282d4187a54299836bb6b4300d15c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:39.277742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-948b4bd8-a008-4d76-b173-744750899da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:39.279389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37289496ce8545589b5f64c4e466d2f9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:39.297440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 865/1758] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:38 2022] DELETE /identity/v3/users/37289496ce8545589b5f64c4e466d2f9 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:39.387516 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 894/1759] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:39.901361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:40.440233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:40.441873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:40.598800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:40.795131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36622028-31cc-4968-b861-39fa82e26826 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:40.836405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:40.840743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:40.841272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:40.841898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] PATH_INFO: `/v3/projects/d54d970431494d76b115f69870d418ae` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:40.846809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54d970431494d76b115f69870d418ae)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:40.858032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:40.920803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57afa9-9686-46d1-8b72-fae880b1fc0b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:40.922875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57afa9-9686-46d1-8b72-fae880b1fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:40.923180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57afa9-9686-46d1-8b72-fae880b1fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:41.117816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6e57afa9-9686-46d1-8b72-fae880b1fc0b None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:41.119370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6e57afa9-9686-46d1-8b72-fae880b1fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:41.125462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54d970431494d76b115f69870d418ae', 'request_id': 'req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:41.139547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54d970431494d76b115f69870d418ae', 'request_id': 'req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:41.213464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 895/1760] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:41.330132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54d970431494d76b115f69870d418ae', 'request_id': 'req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:41.350982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] The token cache is being invalidate because project d54d970431494d76b115f69870d418ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:41.351272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:41.353164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5bcf5423-f0c7-4ee4-a08c-f00efe69ef7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:41.364149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 866/1761] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:40 2022] DELETE /identity/v3/projects/d54d970431494d76b115f69870d418ae => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:41.372150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:41.372466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:41.373056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:41.403763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:41.405587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:41.540498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 896/1762] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:41.548526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:41.548987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:41.549801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:41.580428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:41.581668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:41.596546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:41.598675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 867/1763] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:41.610431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fab4f-5b0e-4220-b556-7a0e02f9fda5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:41.620487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:41.621533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:41.621898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:41.622392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:41.623259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:41.623644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:41.625935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:41.642344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 897/1764] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:46:41.646593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:41.662601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16ecc-833b-4fbf-b68e-ef1b92834045 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:41.677016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:41.683247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:41.685398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:41.685930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:41.686887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:41.688986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:41.725297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:41.753257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:41.757066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:41.798652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962179-cf16-4f19-837e-f514ec1ace39 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:41.827905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:41.828815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:41.829321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:41.829615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] PATH_INFO: `/v3/projects/071e6b7f5e1243229c3afe079539c625` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:41.834934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071e6b7f5e1243229c3afe079539c625)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:41.834934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:41.891432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 868/1765] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:41 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:41.892359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:41.899533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:42.035247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071e6b7f5e1243229c3afe079539c625', 'request_id': 'req-287568c6-0c54-46e6-af98-06dcf5ec7190'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:42.045681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071e6b7f5e1243229c3afe079539c625', 'request_id': 'req-287568c6-0c54-46e6-af98-06dcf5ec7190'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:42.162497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071e6b7f5e1243229c3afe079539c625', 'request_id': 'req-287568c6-0c54-46e6-af98-06dcf5ec7190'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:42.179008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] The token cache is being invalidate because project 071e6b7f5e1243229c3afe079539c625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:42.179464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:42.180359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:42.189528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 898/1766] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:41 2022] DELETE /identity/v3/projects/071e6b7f5e1243229c3afe079539c625 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:42.189528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:42.190483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:42.320270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbbae1-7f5b-4b31-9662-87810efa2393 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:42.399380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287568c6-0c54-46e6-af98-06dcf5ec7190 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:42.415402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850b4fe-a5e2-4f54-8600-9910fb5e001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:42.416410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b4fe-a5e2-4f54-8600-9910fb5e001f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.416796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b4fe-a5e2-4f54-8600-9910fb5e001f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.417173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b4fe-a5e2-4f54-8600-9910fb5e001f admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.427738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b4fe-a5e2-4f54-8600-9910fb5e001f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:42.427738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b4fe-a5e2-4f54-8600-9910fb5e001f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:42.439950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:42.440689 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.440974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.441255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.456662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:42.566926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 899/1767] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:42 2022] POST /identity/v3/users => generated 294 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:42.571244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.573031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.573809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.600445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:42.606915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:42.624566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 869/1768] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:46:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:46:42.625919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:42.628265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:42.641649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:42.643787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:42.647573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff758-df37-471d-bd9d-e25646007879 service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:42.656353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 900/1769] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:42.657768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:42.689455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:42.693639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.694233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.695623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] PATH_INFO: `/v3/users/feb949140b024ee2bc77c9ab572bfab5` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.719955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb949140b024ee2bc77c9ab572bfab5)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:42.722486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:42.757400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07302b-f6d1-4be1-8ba9-c7e8621c3fea None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:42.770331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f22ba-edd3-4741-9703-b3ac3a7ccd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:42.771436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f22ba-edd3-4741-9703-b3ac3a7ccd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.771969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f22ba-edd3-4741-9703-b3ac3a7ccd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.772461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f22ba-edd3-4741-9703-b3ac3a7ccd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.773426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f22ba-edd3-4741-9703-b3ac3a7ccd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:42.778396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f22ba-edd3-4741-9703-b3ac3a7ccd1a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:42.802327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 901/1770] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:42.806068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.806659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.809618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.816274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:42.858241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:42.860084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:42.895658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 902/1771] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:42.896880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:42.938606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cf6a2-f0e7-4e66-8be6-3c8b65920c55 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:42.953132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:42.954331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:42.954873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:42.955348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:42.956266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:42.958100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:43.025153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 903/1772] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:43.026767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:43.053591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d017fe-ea99-440b-b445-dd0a9fd93600 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:43.071959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:43.084991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb949140b024ee2bc77c9ab572bfab5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:43.089430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:43.099410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:43.106898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:43.107716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:43.108560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:43.119765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:43.164396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb949140b024ee2bc77c9ab572bfab5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:43.181287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 904/1773] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:43.187845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:43.194326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb949140b024ee2bc77c9ab572bfab5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:43.196477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb949140b024ee2bc77c9ab572bfab5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:43.224645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb949140b024ee2bc77c9ab572bfab5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:43.230910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c6a9d-4b22-4c04-ab31-d7c0697b5b79 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:43.235850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 870/1774] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:42 2022] DELETE /identity/v3/users/feb949140b024ee2bc77c9ab572bfab5 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:43.240927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:43.245803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:43.252419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e768-3a95-4332-b315-5da19d96a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:43.259610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e768-3a95-4332-b315-5da19d96a035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:43.260248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e768-3a95-4332-b315-5da19d96a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:43.260738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e768-3a95-4332-b315-5da19d96a035 admin admin] PATH_INFO: `/v3/projects/d00001d7491746e6a5d6ea56d403c125/users/eb9ede48a8fb44c381434a1250ddd89f/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:43.298663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201e768-3a95-4332-b315-5da19d96a035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00001d7491746e6a5d6ea56d403c125, user_id=eb9ede48a8fb44c381434a1250ddd89f, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:43.301728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201e768-3a95-4332-b315-5da19d96a035 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:43.461791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162af8-13af-45fa-b5c5-56b726db1d46 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:43.472347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e366-af4f-4c10-8519-34263bc1fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:43.474621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e366-af4f-4c10-8519-34263bc1fdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:43.479854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e366-af4f-4c10-8519-34263bc1fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:43.479854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e366-af4f-4c10-8519-34263bc1fdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:43.479854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e366-af4f-4c10-8519-34263bc1fdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:43.480869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e366-af4f-4c10-8519-34263bc1fdbf admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:43.485075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 905/1775] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:43 2022] PUT /identity/v3/projects/d00001d7491746e6a5d6ea56d403c125/users/eb9ede48a8fb44c381434a1250ddd89f/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:43.487430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:43.487924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:43.488319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:43.538121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:43.541792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:43.647515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 871/1776] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:43 2022] POST /identity/v3/projects => generated 407 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:43.653027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:43.654315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:43.654805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:43.723248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] MFA Rules not processed for user `eb9ede48a8fb44c381434a1250ddd89f`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:43.725294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:43.735619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 906/1777] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:43.743374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:43.792121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea57b06-9134-4190-ab0e-812481d4a441 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:43.939598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 872/1778] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:43.943051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:43.946762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:43.968399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:43.969995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:43.970500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:43.971132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:43.973138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:43.979339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:44.087531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 907/1779] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:43 2022] POST /identity/v3/users => generated 304 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:44.090084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:44.095938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:44.146515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb67ce-eb8c-4bce-a48e-67548f6b4575 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:44.190329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:44.190329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:44.190329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:44.190329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:44.190636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:44.208250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:44.275333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492af2b-164c-44b9-b808-608eac973bf6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:44.296459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:44.303534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:44.303534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:44.303806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:44.336849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:44.341935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:44.419445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 873/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:44.420679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:44.522184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 908/1781] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:44 2022] POST /identity/v3/projects => generated 385 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:44.524591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210d5e-799d-4075-b10b-c299a6a319f2 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:44.524979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:44.710418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:44.716916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:44.717772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:44.718997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:44.720910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:44.723430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:44.749327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 874/1782] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:44.754010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:44.764383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b4b6-0ca7-4d15-ba1f-8377a68d1b5e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:44.767532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a2bb-4dad-4661-9948-460cdf4fade1 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:44.791050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:44.792178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:44.792925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:44.793590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:44.794837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:44.797359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:44.800773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:44.801806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:44.802100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:44.805676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:44.809478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:44.813312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 875/1783] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:44.816442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:44.819003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:44.855694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d27ed7-ccc4-47cb-af1a-21c7ef65dfe2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:44.861625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5385-036b-4737-bf49-60b39c06ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:44.862585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5385-036b-4737-bf49-60b39c06ae1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:44.862915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5385-036b-4737-bf49-60b39c06ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:44.863225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5385-036b-4737-bf49-60b39c06ae1e admin admin] PATH_INFO: `/v3/projects/2cd68048a5f7449c957662152b3a16da/users/832a686c9c65429aaa9780e6868f938b/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:44.900997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd5385-036b-4737-bf49-60b39c06ae1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd68048a5f7449c957662152b3a16da, user_id=832a686c9c65429aaa9780e6868f938b, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:44.904831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd5385-036b-4737-bf49-60b39c06ae1e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:45.012372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 909/1784] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:44 2022] POST /identity/v3/users => generated 299 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:45.013923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:45.050825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e36fb-f2b5-44b5-9ce6-64d9dc1fa76b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:45.070606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:45.072623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:45.072952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:45.073794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:45.074618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:45.087344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:45.106418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 876/1785] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:44 2022] PUT /identity/v3/projects/2cd68048a5f7449c957662152b3a16da/users/832a686c9c65429aaa9780e6868f938b/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:45.108114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66378f-38e0-41ad-862e-1a526fc5bc3e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:45.108429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66378f-38e0-41ad-862e-1a526fc5bc3e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:45.109767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66378f-38e0-41ad-862e-1a526fc5bc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:45.117729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 910/1786] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:45.129227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:45.153485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdb117-8b09-4f05-b8f2-c62c6ee7c71a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:45.190142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4f66378f-38e0-41ad-862e-1a526fc5bc3e None None] MFA Rules not processed for user `832a686c9c65429aaa9780e6868f938b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:45.194823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4f66378f-38e0-41ad-862e-1a526fc5bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:45.210178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:45.324171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:45.325105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:45.325391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:45.325673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] PATH_INFO: `/v3/projects/d6269ab6d71d4f3cad7650ba4096116c/users/1ddd4422914b4b5ab243a67d0e05da90/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:45.381799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6269ab6d71d4f3cad7650ba4096116c, user_id=1ddd4422914b4b5ab243a67d0e05da90, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:45.381799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:45.394613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 877/1787] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:45.396699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:45.398616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:45.399640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:45.446303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:45.450022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:45.512907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 911/1788] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:45 2022] PUT /identity/v3/projects/d6269ab6d71d4f3cad7650ba4096116c/users/1ddd4422914b4b5ab243a67d0e05da90/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:45.514604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:45.663060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 878/1789] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jul 21 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:45.664464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:45.695196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b35a-193c-4154-b89f-975d47af5985 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:45.878509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a52f-4aaa-4fee-97b8-eb98b2e28248 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:45.919086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:45.926056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:45.927753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:45.933585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:45.933585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:45.933585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:45.933955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:45.938513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:45.939517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:45.940280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:45.942754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:45.956645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 879/1790] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:45.956759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:45.956843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:45.956843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:46.098662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 912/1791] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:45 2022] POST /identity/v3/projects => generated 407 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:46.098662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:46.100007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515bf55-dd84-4db9-a96f-cbfcb9465556 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:46.173829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:46.178285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5a69e-2903-423f-9ca9-863504cfe247 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:46.186035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:46.186799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.187213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.187576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.200806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:46.203759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:46.205010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.206867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.208758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.219149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 913/1792] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:46.220013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:46.233209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:46.236629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:46.272071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 880/1793] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:46.275418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:46.277969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:46.375338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d94809-93a8-4ed4-8756-5b4f03c0a467 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:46.381250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:46.383651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.383651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.383651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] PATH_INFO: `/v3/projects/d6269ab6d71d4f3cad7650ba4096116c/users/1ddd4422914b4b5ab243a67d0e05da90/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.387784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6269ab6d71d4f3cad7650ba4096116c, user_id=1ddd4422914b4b5ab243a67d0e05da90, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:46.402358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:46.415503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c447a5-89b8-4fb0-8178-7f0d483b4081 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:46.424017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 914/1794] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:46 2022] PUT /identity/v3/projects/d6269ab6d71d4f3cad7650ba4096116c/users/1ddd4422914b4b5ab243a67d0e05da90/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:46.425429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:46.561994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6fa7-928b-44b5-8858-4a510c17d266 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:46.566572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:46.567619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.568136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.569221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.579266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:46.581445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:46.592881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 915/1795] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:46.595299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:46.595423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3027-84eb-4bbf-8bd4-ba3cec5f2158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:46.596091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3027-84eb-4bbf-8bd4-ba3cec5f2158 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.596378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3027-84eb-4bbf-8bd4-ba3cec5f2158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.596656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3027-84eb-4bbf-8bd4-ba3cec5f2158 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.598049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3027-84eb-4bbf-8bd4-ba3cec5f2158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:46.598384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:46.601155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3027-84eb-4bbf-8bd4-ba3cec5f2158 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:46.621202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c68a6-0746-4475-b5a9-e24447520ac0 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:46.626995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:46.628434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.628943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.629512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] PATH_INFO: `/v3/projects/1d097e566a4f464494548f232b5a9c38` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.632139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d097e566a4f464494548f232b5a9c38)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:46.637306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:46.759036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 881/1796] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:46 2022] POST /identity/v3/users => generated 310 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:46.761459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:46.764966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:46.765539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:46.804502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] MFA Rules not processed for user `1ddd4422914b4b5ab243a67d0e05da90`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:46.809021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:46.825714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d097e566a4f464494548f232b5a9c38', 'request_id': 'req-f0a33706-d726-47db-88af-ffc4cf6046e3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:46.834882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d097e566a4f464494548f232b5a9c38', 'request_id': 'req-f0a33706-d726-47db-88af-ffc4cf6046e3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:46.975033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d097e566a4f464494548f232b5a9c38', 'request_id': 'req-f0a33706-d726-47db-88af-ffc4cf6046e3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:46.999280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:47.003023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] The token cache is being invalidate because project 1d097e566a4f464494548f232b5a9c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:47.003322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.004995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 882/1797] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:47.005884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:47.006463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.013845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 916/1798] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:46 2022] DELETE /identity/v3/projects/1d097e566a4f464494548f232b5a9c38 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:47.017727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:47.031134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:47.086294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:47.146229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33706-d726-47db-88af-ffc4cf6046e3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:47.154238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:47.156028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:47.157230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:47.158062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] PATH_INFO: `/v3/users/9708d7a697224f9d9c1e9d42760aacc2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:47.163392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9708d7a697224f9d9c1e9d42760aacc2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:47.167576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:47.231642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097538b9-77c8-46c0-93df-10a9237fd684 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:47.252750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:47.253550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:47.254080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:47.254437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:47.255661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:47.257832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:47.291063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 883/1799] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:47.295825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:47.309683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:47.361237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9708d7a697224f9d9c1e9d42760aacc2'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.462463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9708d7a697224f9d9c1e9d42760aacc2'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.463214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9708d7a697224f9d9c1e9d42760aacc2'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.477202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9708d7a697224f9d9c1e9d42760aacc2'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.514730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f873eda-8b74-47f8-a904-95749bfed65e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:47.516280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9708d7a697224f9d9c1e9d42760aacc2'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:47.524527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 917/1800] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:47 2022] DELETE /identity/v3/users/9708d7a697224f9d9c1e9d42760aacc2 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:47.525686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:47.531185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:47.532364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:47.533993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:47.534337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:47.539610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:47.543555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:47.581415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:47.582935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:47.597646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 884/1801] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:47.712419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:47.713902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:47.721437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd4de-3e8f-40a4-9815-b5edfd80cab6 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:47.748934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:47.749111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3966ba7-9f82-43c6-b021-79c595b45833 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:47.758317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:47.759168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:47.762257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] PATH_INFO: `/v3/projects/eeabed0244954be9af11c9fc8d0d58f8/users/0840b3545380459a9bb3aea925a190b4/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:47.765187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:47.766107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:47.766400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:47.766675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] PATH_INFO: `/v3/users/eb9ede48a8fb44c381434a1250ddd89f` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:47.768893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9ede48a8fb44c381434a1250ddd89f)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:47.770722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:47.835120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeabed0244954be9af11c9fc8d0d58f8, user_id=0840b3545380459a9bb3aea925a190b4, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:47.838167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:47.966531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 918/1802] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:47 2022] PUT /identity/v3/projects/eeabed0244954be9af11c9fc8d0d58f8/users/0840b3545380459a9bb3aea925a190b4/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:47.970579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:48.075483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9ede48a8fb44c381434a1250ddd89f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:48.169718 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235db6-2560-4800-b966-e87fb6acd0fb admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:48.175695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9ede48a8fb44c381434a1250ddd89f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:48.178180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:48.178994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.179414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.179699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.180292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:48.182268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:48.204029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9ede48a8fb44c381434a1250ddd89f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:48.204856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9ede48a8fb44c381434a1250ddd89f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:48.208998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 919/1803] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:46:48.213576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5dce9929-0639-46f5-a30d-ffb4ebaa5a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9ede48a8fb44c381434a1250ddd89f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:48.213677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:48.220682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:48.234417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 885/1804] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:47 2022] DELETE /identity/v3/users/eb9ede48a8fb44c381434a1250ddd89f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:48.243047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.243524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.243890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.246480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dbaa-e8d3-43b3-a794-bdd5d2cece9c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:48.253894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:48.332070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:48.333434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:48.404037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d729f2a-4dfd-4f5a-8a61-754472f05dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:48.407831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729f2a-4dfd-4f5a-8a61-754472f05dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.408879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729f2a-4dfd-4f5a-8a61-754472f05dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.409386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729f2a-4dfd-4f5a-8a61-754472f05dab admin admin] PATH_INFO: `/v3/projects/eeabed0244954be9af11c9fc8d0d58f8/users/0840b3545380459a9bb3aea925a190b4/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.415838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d729f2a-4dfd-4f5a-8a61-754472f05dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeabed0244954be9af11c9fc8d0d58f8, user_id=0840b3545380459a9bb3aea925a190b4, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:48.420588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d729f2a-4dfd-4f5a-8a61-754472f05dab admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:48.459863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 920/1805] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:48 2022] PUT /identity/v3/projects/eeabed0244954be9af11c9fc8d0d58f8/users/0840b3545380459a9bb3aea925a190b4/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:48.474283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.479641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.479641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.493095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 886/1806] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:48.551687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] MFA Rules not processed for user `0840b3545380459a9bb3aea925a190b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:48.554903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:48.570083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:48.572135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:48.691604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 921/1807] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:48.696793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5271d-fae8-487e-aee5-c7d6e4aaf0e8 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:48.705991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:48.707994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:48.798649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265351-d6a3-47b8-b43d-e57383da876e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:48.804207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9ad56-d297-4667-839c-2d49557837f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:48.805033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ad56-d297-4667-839c-2d49557837f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.805469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ad56-d297-4667-839c-2d49557837f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.805833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ad56-d297-4667-839c-2d49557837f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.822752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9ad56-d297-4667-839c-2d49557837f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:48.824623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9ad56-d297-4667-839c-2d49557837f7 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:48.842221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 922/1808] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:48.849001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc23f36-3d4e-4cff-98b4-1244dca9abd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:48.850013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc23f36-3d4e-4cff-98b4-1244dca9abd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:48.850496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc23f36-3d4e-4cff-98b4-1244dca9abd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:48.850989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc23f36-3d4e-4cff-98b4-1244dca9abd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:48.894530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:49.116323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc23f36-3d4e-4cff-98b4-1244dca9abd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:49.119369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc23f36-3d4e-4cff-98b4-1244dca9abd5 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:49.146051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 887/1809] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:49.150280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c36d1-a590-4d54-86d2-1a59f603c819 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:49.150568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c36d1-a590-4d54-86d2-1a59f603c819 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:49.150882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c36d1-a590-4d54-86d2-1a59f603c819 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:49.156980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 923/1810] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:46:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:49.306915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:49.307351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:49.309441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:49.337003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:49.338480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:49.505070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 888/1811] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:49.547053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c36d1-a590-4d54-86d2-1a59f603c819 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:49.548944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c90c36d1-a590-4d54-86d2-1a59f603c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:49.591736 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c36d1-a590-4d54-86d2-1a59f603c819 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:49.611706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:49.612753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:49.617355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:49.617355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:49.640909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:49.644655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:49.675148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:49.676509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:49.691885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:49.692087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 924/1812] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:49.695093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d404d-161a-40d3-baae-75ef087bfd73 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:49.700041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:49.700758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:49.701065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:49.701349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:49.703654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:49.794717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:49.884589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:49.898055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:49.919046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 889/1813] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:50.136564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:50.145024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:50.181358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c5cf-67ca-4a7a-b67e-39589fa2e09d service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:50.201857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:50.202867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:50.203285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:50.203574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] PATH_INFO: `/v3/users/645654d902764e7288237138159ee936` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:50.204913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645654d902764e7288237138159ee936)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:50.207306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:50.525894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645654d902764e7288237138159ee936'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.583433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:50.586122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:50.615877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645654d902764e7288237138159ee936'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.616682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645654d902764e7288237138159ee936'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.628632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645654d902764e7288237138159ee936'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.632819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b7c20-caf4-4428-b49c-86d4e733dbb5 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:50.672401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:50.675532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:50.679047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:50.679295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] PATH_INFO: `/v3/projects/fcb5b5c10e644af887794302b9abdabb` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:50.682400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb5b5c10e644af887794302b9abdabb)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:50.696340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-327e37b5-bfad-4b27-ab95-1604cd0046e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645654d902764e7288237138159ee936'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.703438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:50.717163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 925/1814] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:50 2022] DELETE /identity/v3/users/645654d902764e7288237138159ee936 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:50.719517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:50.719940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:50.720403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:50.764962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:50.770416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:50.903890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb5b5c10e644af887794302b9abdabb', 'request_id': 'req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.928245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb5b5c10e644af887794302b9abdabb', 'request_id': 'req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:50.976333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 926/1815] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:51.007071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb5b5c10e644af887794302b9abdabb', 'request_id': 'req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.007378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.011783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.032111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] The token cache is being invalidate because project fcb5b5c10e644af887794302b9abdabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:51.032992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.034389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4e7a9a7a-1f59-410e-91ee-57b4d6c51085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:51.037898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 890/1816] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:50 2022] DELETE /identity/v3/projects/fcb5b5c10e644af887794302b9abdabb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:51.043595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e118-a543-48b3-a1e4-10bc03f7f582 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.044319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e118-a543-48b3-a1e4-10bc03f7f582 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.044807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e118-a543-48b3-a1e4-10bc03f7f582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.070188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-0f96e118-a543-48b3-a1e4-10bc03f7f582 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:51.093577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0f96e118-a543-48b3-a1e4-10bc03f7f582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.105510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfb523-cd34-4098-b5c9-dea5b306be13 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.176552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 891/1817] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:51.178656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.186930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.187428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.213719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:51.216110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.236068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.236794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.237118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.237600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.257523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:51.266190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 892/1818] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:51.267722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.278579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.279628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:51.281976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8758ae-4dff-495b-b1fc-93cc5e75e7bd None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.287597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.289022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.289932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.290575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.291730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:51.292574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.294821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:51.314235 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 893/1819] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:51.316846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.343032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dbd0f-0d3f-4877-a2bb-0696cade732b admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.343437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 927/1820] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:51.360464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.361843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.362422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.363180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.364193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.366659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:51.564317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 894/1821] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:51 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:51.572404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.600827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0b1c-469a-4661-ab21-6d732fb759c3 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.790472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.792910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.793200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.793479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.796255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.800275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:51.947816 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 928/1822] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:51 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:51.947999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:51.963524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e921-a3c1-4f1c-b27c-5571979cb371 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:51.985030 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:51.990160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:51.990160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:51.990160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:51.990160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:51.990160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.032486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 895/1823] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:52.036904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.054801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e918-239a-4565-a63b-e8c6ffdab6e4 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.074870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.080631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.080631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.080631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.080631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.080631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.108080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.118665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.135515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 929/1824] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:52.140470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.163270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c999f7-42d3-4141-a87d-bbe3456ad28f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.174821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82202939-8d49-41ca-a651-40f6415259e7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.196519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.197820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.199201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.202011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] PATH_INFO: `/v3/projects/d00001d7491746e6a5d6ea56d403c125` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.205825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00001d7491746e6a5d6ea56d403c125)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.208013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.209790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1844-4f47-4c5e-92d8-1aa598c1b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.211179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1844-4f47-4c5e-92d8-1aa598c1b7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.211465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1844-4f47-4c5e-92d8-1aa598c1b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.211743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1844-4f47-4c5e-92d8-1aa598c1b7c4 admin admin] PATH_INFO: `/v3/projects/f67d8699443b485bba3807b52f212d87/users/bda6bde2688b44219b7b873f10740630/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.252422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1844-4f47-4c5e-92d8-1aa598c1b7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67d8699443b485bba3807b52f212d87, user_id=bda6bde2688b44219b7b873f10740630, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.258602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1844-4f47-4c5e-92d8-1aa598c1b7c4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.305758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:52.380404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 930/1825] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:52 2022] PUT /identity/v3/projects/f67d8699443b485bba3807b52f212d87/users/bda6bde2688b44219b7b873f10740630/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:52.384941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d77a4b-70d5-49b0-9674-b403c8f3a4cc None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.385362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d77a4b-70d5-49b0-9674-b403c8f3a4cc None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.385655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d77a4b-70d5-49b0-9674-b403c8f3a4cc None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.389978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 931/1826] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:46:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:46:52.393405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.393697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.393977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.477202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00001d7491746e6a5d6ea56d403c125', 'request_id': 'req-f7d94da4-79ba-430e-9470-ff15eb757e40'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.491590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00001d7491746e6a5d6ea56d403c125', 'request_id': 'req-f7d94da4-79ba-430e-9470-ff15eb757e40'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.506762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] MFA Rules not processed for user `bda6bde2688b44219b7b873f10740630`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:52.507953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.541672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:52.603075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00001d7491746e6a5d6ea56d403c125', 'request_id': 'req-f7d94da4-79ba-430e-9470-ff15eb757e40'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.621356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] The token cache is being invalidate because project d00001d7491746e6a5d6ea56d403c125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:52.621719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.624421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7d94da4-79ba-430e-9470-ff15eb757e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:52.627794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 896/1827] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:52 2022] DELETE /identity/v3/projects/d00001d7491746e6a5d6ea56d403c125 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:52.634502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.635230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 932/1828] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:52.636859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.637178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.646352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.646352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.677037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:52.678296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.837627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a551a-9c38-4756-91e9-5e0750e3bcb4 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.848937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.849833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.852853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.852853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] PATH_INFO: `/v3/projects/51c8d4eff8b64dcd9680bce9bf435e30` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.852853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c8d4eff8b64dcd9680bce9bf435e30)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.853916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:52.885113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 897/1829] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:52.886816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:52.888612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:52.906392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c656b2-76e0-4041-85d8-16d4cc94ab0d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:52.912834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:52.918298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:52.918298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:52.918298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] PATH_INFO: `/v3/users/1ddd4422914b4b5ab243a67d0e05da90` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:52.918298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddd4422914b4b5ab243a67d0e05da90)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:52.918638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.010108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c8d4eff8b64dcd9680bce9bf435e30', 'request_id': 'req-1765b039-1f5a-44fe-8aad-d6f1a517685e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.018799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c8d4eff8b64dcd9680bce9bf435e30', 'request_id': 'req-1765b039-1f5a-44fe-8aad-d6f1a517685e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.100041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c8d4eff8b64dcd9680bce9bf435e30', 'request_id': 'req-1765b039-1f5a-44fe-8aad-d6f1a517685e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.117342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] The token cache is being invalidate because project 51c8d4eff8b64dcd9680bce9bf435e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:53.117697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.118293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.122086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 933/1830] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:52 2022] DELETE /identity/v3/projects/51c8d4eff8b64dcd9680bce9bf435e30 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:53.122950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:53.125308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:53.152236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddd4422914b4b5ab243a67d0e05da90'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.291745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765b039-1f5a-44fe-8aad-d6f1a517685e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:53.297343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:53.298430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:53.299007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:53.299481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:53.300559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:53.304272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.323093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddd4422914b4b5ab243a67d0e05da90'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.343932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddd4422914b4b5ab243a67d0e05da90'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.346056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddd4422914b4b5ab243a67d0e05da90'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.367473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddd4422914b4b5ab243a67d0e05da90'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:53.379822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 898/1831] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:52 2022] DELETE /identity/v3/users/1ddd4422914b4b5ab243a67d0e05da90 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:53.381574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:53.385351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:53.520668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 934/1832] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:53 2022] POST /identity/v3/projects => generated 381 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:53.520668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:53.522088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:53.533473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a54a-83a6-4c90-ae19-59faf6981222 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:53.680017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:53.681107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:53.681492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:53.681881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] PATH_INFO: `/v3/users/d45c0097abcd4d30a547ca88ee8281b9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:53.684323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45c0097abcd4d30a547ca88ee8281b9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:53.687362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.687761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff5bbb-9c6f-45d0-96f1-f8e228b29414 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:53.701426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:53.702361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:53.702650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:53.703166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:53.706711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:53.729024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:53.731414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.746168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 935/1833] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:53.747049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:53.748456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:53.763384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321f412-4e08-4559-b1f0-3a98145e818e service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:53.791501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:53.792792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:53.794930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:53.794930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:53.794930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:53.797456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.896606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 936/1834] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:53 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:53.899530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:53.925797 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35f72-7b8f-4809-b60e-1a169afd1f69 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:53.941729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:53.947352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:53.947743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:53.949627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:53.950422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:53.956400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:53.985692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 937/1835] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:53.989859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:54.004819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45c0097abcd4d30a547ca88ee8281b9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:54.006044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6b0a3-dd3c-4135-b1fa-2ab49cd1056b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:54.013449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:54.018578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:54.018886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:54.019172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] PATH_INFO: `/v3/projects/349ce8878a934fa8a9cebe48add7b301/users/62dff48bb2644d6eab03a4d863321caf/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:54.037417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=349ce8878a934fa8a9cebe48add7b301, user_id=62dff48bb2644d6eab03a4d863321caf, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:54.050465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:54.105883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45c0097abcd4d30a547ca88ee8281b9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:54.122515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45c0097abcd4d30a547ca88ee8281b9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:54.123609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45c0097abcd4d30a547ca88ee8281b9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:54.139668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45c0097abcd4d30a547ca88ee8281b9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:54.156745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 899/1836] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:53 2022] DELETE /identity/v3/users/d45c0097abcd4d30a547ca88ee8281b9 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:54.176031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 938/1837] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:53 2022] PUT /identity/v3/projects/349ce8878a934fa8a9cebe48add7b301/users/62dff48bb2644d6eab03a4d863321caf/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:54.176875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:54.178669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:54.297237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823b40-31ac-43be-96f3-b917f9fdf489 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:54.390971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57061bd8-640c-4339-aa50-5a92be20c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:54.392121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57061bd8-640c-4339-aa50-5a92be20c43d admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:54.392518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57061bd8-640c-4339-aa50-5a92be20c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:54.392804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57061bd8-640c-4339-aa50-5a92be20c43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:54.393860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57061bd8-640c-4339-aa50-5a92be20c43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:54.396185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57061bd8-640c-4339-aa50-5a92be20c43d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:54.421230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:54.422015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 900/1838] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:46:54.435018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406dba3-ad17-4824-8294-79c8df5295e2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:54.462461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:54.476016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:54.478300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:54.480995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] PATH_INFO: `/v3/projects/349ce8878a934fa8a9cebe48add7b301/users/62dff48bb2644d6eab03a4d863321caf/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:54.485881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=349ce8878a934fa8a9cebe48add7b301, user_id=62dff48bb2644d6eab03a4d863321caf, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:54.493064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:54.532312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 939/1839] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:54 2022] PUT /identity/v3/projects/349ce8878a934fa8a9cebe48add7b301/users/62dff48bb2644d6eab03a4d863321caf/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:54.543755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:54.558608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:54.558608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:54.613294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] MFA Rules not processed for user `62dff48bb2644d6eab03a4d863321caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:54.619221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:54.802272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 901/1840] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:54.815748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:54.818389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:54.939478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36437262-c143-4ecd-8d71-199cab90a0b8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:54.949226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3e7f-758c-465b-b94b-e17bdc0abab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:54.950073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3e7f-758c-465b-b94b-e17bdc0abab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:54.950363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3e7f-758c-465b-b94b-e17bdc0abab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:54.950902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3e7f-758c-465b-b94b-e17bdc0abab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:54.975892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f3e7f-758c-465b-b94b-e17bdc0abab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:54.977798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f3e7f-758c-465b-b94b-e17bdc0abab8 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:55.043380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 940/1841] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:46:55.150968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:55.152992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:55.306404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c059-33d4-4537-929e-f07edc0567bb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:55.314774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:55.315943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:55.320455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:55.320455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] PATH_INFO: `/v3/projects/d6269ab6d71d4f3cad7650ba4096116c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:55.320455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6269ab6d71d4f3cad7650ba4096116c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:55.322439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:55.553630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:55.556048 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6269ab6d71d4f3cad7650ba4096116c', 'request_id': 'req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:55.578440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6269ab6d71d4f3cad7650ba4096116c', 'request_id': 'req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:55.701607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6269ab6d71d4f3cad7650ba4096116c', 'request_id': 'req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:55.717586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] The token cache is being invalidate because project d6269ab6d71d4f3cad7650ba4096116c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:55.725238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:55.726354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:55.736641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 902/1842] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:55 2022] DELETE /identity/v3/projects/d6269ab6d71d4f3cad7650ba4096116c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:55.738716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9669-46e6-4630-954e-b6c8d5213d9a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:55.739173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9669-46e6-4630-954e-b6c8d5213d9a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:55.739535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9669-46e6-4630-954e-b6c8d5213d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:55.769128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:55.771611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:55.817403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-007f9669-46e6-4630-954e-b6c8d5213d9a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:55.819318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-007f9669-46e6-4630-954e-b6c8d5213d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:55.926371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f940e09-fcb3-4282-b1c0-29eb9bbb4f0f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:55.937068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:55.939245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:55.940165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:55.940771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] PATH_INFO: `/v3/projects/8bfaa8a521c942e39207a6ebe423fed1` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:55.944303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfaa8a521c942e39207a6ebe423fed1)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:55.947247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:55.961166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 941/1843] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:55.969212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:55.969503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:55.974492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:55.999264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:56.001719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:56.017561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 942/1844] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:56.021892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:56.049533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f527fb-05fe-4e42-be93-fd8d6944e7e7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:56.062752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:56.062752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.063092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.063329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.066483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:56.066483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:56.070872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:56.090350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 943/1845] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:56.094835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:56.119582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d245196-3ea7-47df-a51c-545783c0d598 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:56.154674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfaa8a521c942e39207a6ebe423fed1', 'request_id': 'req-06227037-0284-4509-b3cf-05ca6fed737c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:56.173246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfaa8a521c942e39207a6ebe423fed1', 'request_id': 'req-06227037-0284-4509-b3cf-05ca6fed737c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:56.233450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:56.234175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.234436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.234739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.235778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:56.239530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:56.284688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfaa8a521c942e39207a6ebe423fed1', 'request_id': 'req-06227037-0284-4509-b3cf-05ca6fed737c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:56.311676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] The token cache is being invalidate because project 8bfaa8a521c942e39207a6ebe423fed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:56.312281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:56.313071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-06227037-0284-4509-b3cf-05ca6fed737c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:56.326529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 903/1846] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:55 2022] DELETE /identity/v3/projects/8bfaa8a521c942e39207a6ebe423fed1 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:56.328163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0b3f-174e-442d-87cf-6fbd1d323747 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.328461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0b3f-174e-442d-87cf-6fbd1d323747 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.329286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0b3f-174e-442d-87cf-6fbd1d323747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.377889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 944/1847] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:56 2022] POST /identity/v3/projects => generated 387 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:46:56.399918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:56.412170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:56.428091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e2ad0b3f-174e-442d-87cf-6fbd1d323747 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:56.436080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e2ad0b3f-174e-442d-87cf-6fbd1d323747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:56.576279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f6f7b-77de-402e-ae42-01c646c9a2dc admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:56.590846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:56.606941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.606941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.606941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.606941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:56.607330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 904/1848] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:56.615659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:56.629168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.629639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.629850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.678629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:56.678629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:56.678629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 905/1849] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:56.684841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:56.703550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47c8e-7e9b-4f67-90b5-2fcf497174ff None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:56.709615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:56.710302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.710595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.710907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.711651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:56.712014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:56.713943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:56.730674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 906/1850] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:56.731623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:56.733384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:56.836723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620762c4-ae6a-4e9a-b7ea-c835e7e88d27 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:56.842927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62dff48bb2644d6eab03a4d863321caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '349ce8878a934fa8a9cebe48add7b301', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:56.843885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.844175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.844459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.845207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:56.845526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:56.847255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:56.861498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 907/1851] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:56.862364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:56.873929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47851-fb96-41bc-81fd-ccd9511bc28d tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:56.880554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:56.881398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:56.881625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:56.881901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:56.886720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:56.888729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.076770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:57.087011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 908/1852] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:56 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:57.090895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 945/1853] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:56 2022] POST /identity/v3/users => generated 294 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:57.091840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.093069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.108830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e8a28-5575-4d90-96fe-e106fb1ebdce admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.164524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcad25-4163-4559-aa8a-3d9acb6b4908 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.173508 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62dff48bb2644d6eab03a4d863321caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '349ce8878a934fa8a9cebe48add7b301', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.174357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.174653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.174966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.175799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.176019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.176678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.177115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.178433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.179045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.180073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.182226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.303202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 946/1854] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:57 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:57.303202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.310705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e064b2-4e63-4a25-86a6-940f092b001d admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.315309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.315995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.316277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.316551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.317314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.318912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.332050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 947/1855] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:57.333376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.342206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 909/1856] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:57 2022] POST /identity/v3/projects => generated 352 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:57.343212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.347363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96a49f-4f51-41ea-8ea8-7acf99ebe22c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.420492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c9ed-1550-4a73-8b58-ab751c60da40 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.424863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.425561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.425889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.426262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.426968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.428706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.442115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.442934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 910/1857] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:57.443057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.443212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.443520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.444277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.446212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.446907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.469501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 948/1858] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:57.469501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.479779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018b0e-1bec-4fcb-85f0-e0b5a4f1bac1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.484759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.485656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.485938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.486278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] PATH_INFO: `/v3/projects/c6d46c146fe54edbae185964cf79311f/users/fb50c15264044732b8dac0b899ea3d6b/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.505754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d46c146fe54edbae185964cf79311f, user_id=fb50c15264044732b8dac0b899ea3d6b, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.508451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.520380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb961c-8008-4f3d-b067-0833e45c2a51 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.525061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62dff48bb2644d6eab03a4d863321caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '349ce8878a934fa8a9cebe48add7b301', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.526551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.526551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.526551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.527169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:46:57.527460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.529293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.541316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 911/1859] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:46:57.541316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.554813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77ab4-4329-42be-a1b8-89c65a84caa3 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.564089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.565308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.565932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.566371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.567409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.569520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.585281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 912/1860] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:57.586959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.602493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f402b-e838-471f-b569-c48a51304dfe admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.603589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 949/1861] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:57 2022] PUT /identity/v3/projects/c6d46c146fe54edbae185964cf79311f/users/fb50c15264044732b8dac0b899ea3d6b/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:57.604552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.692815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62dff48bb2644d6eab03a4d863321caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '349ce8878a934fa8a9cebe48add7b301', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.693748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.694036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.694318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] PATH_INFO: `/v3/projects/62337eb2ae644c69849559f2a7d730bc` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.696402 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorizing `identity:delete_project(project_id=62337eb2ae644c69849559f2a7d730bc)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.699342 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.699689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b973-7218-4a31-9ab6-dd13a8609d1a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:57.707142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5670d1-1afe-4304-b1dc-0bf2a88390fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:57.709828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5670d1-1afe-4304-b1dc-0bf2a88390fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.710271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5670d1-1afe-4304-b1dc-0bf2a88390fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.711323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5670d1-1afe-4304-b1dc-0bf2a88390fe admin admin] PATH_INFO: `/v3/projects/61a0378ab916492d9e48048881b6df28/users/8cf59045d9eb4a3d8cf0e0ea57fc7268/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.734192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5670d1-1afe-4304-b1dc-0bf2a88390fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a0378ab916492d9e48048881b6df28, user_id=8cf59045d9eb4a3d8cf0e0ea57fc7268, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:57.736522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5670d1-1afe-4304-b1dc-0bf2a88390fe admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:57.832367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 950/1862] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:57 2022] PUT /identity/v3/projects/61a0378ab916492d9e48048881b6df28/users/8cf59045d9eb4a3d8cf0e0ea57fc7268/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:57.834011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f687a-05bb-4379-a342-ce9bd1de421d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.834303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f687a-05bb-4379-a342-ce9bd1de421d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.834578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f687a-05bb-4379-a342-ce9bd1de421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.851383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62337eb2ae644c69849559f2a7d730bc', 'request_id': 'req-8e65709f-7b65-452a-815c-a17f3516e6a0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:57.858083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62337eb2ae644c69849559f2a7d730bc', 'request_id': 'req-8e65709f-7b65-452a-815c-a17f3516e6a0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:57.864636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c62f687a-05bb-4379-a342-ce9bd1de421d None None] MFA Rules not processed for user `fb50c15264044732b8dac0b899ea3d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:57.866161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c62f687a-05bb-4379-a342-ce9bd1de421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:57.931853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 951/1863] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:57.933714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:57.933714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:57.934023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:57.941702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62337eb2ae644c69849559f2a7d730bc', 'request_id': 'req-8e65709f-7b65-452a-815c-a17f3516e6a0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:57.951734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:57.952951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:57.954055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] The token cache is being invalidate because project 62337eb2ae644c69849559f2a7d730bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:46:57.954556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:57.955046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:57.956930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 913/1864] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:46:57 2022] DELETE /identity/v3/projects/62337eb2ae644c69849559f2a7d730bc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:57.957829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:57.959220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:58.017125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 952/1865] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:58.026943 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.028980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:58.037828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65709f-7b65-452a-815c-a17f3516e6a0 tempest-VolumeQuotaClassesTest-1899134980 tempest-VolumeQuotaClassesTest-1899134980-project-admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.044183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.045430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.045761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.046007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.046798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.049066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.095535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24d0d0-d641-4bc0-9fc5-f1abc0054d39 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.099590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.100250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.100719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.101002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.110621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.112209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.122308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 953/1866] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:58.142727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 914/1867] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:46:57 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:58.147077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.158287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f2b1-a307-4548-bb03-f4290f4ac0a1 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.227684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.228361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.228649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.228926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.229620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.231598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.351082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 954/1868] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:46:58 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:46:58.352644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.363179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c1b0-057a-40cc-bb95-32dd622df6b8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.368077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.368751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.369036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.369355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.370122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.372531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.389526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 915/1869] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:58.393952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.405045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8af40f-938b-4c7d-b89b-66df3d4d167c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.409683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.414094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.414094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.414094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] PATH_INFO: `/v3/projects/cb1f62f2b04d40789e5bdb00f88870c6/users/11d0f234305a4409804698a34218dcb0/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.426251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1f62f2b04d40789e5bdb00f88870c6, user_id=11d0f234305a4409804698a34218dcb0, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.428953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.565034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 955/1870] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:58 2022] PUT /identity/v3/projects/cb1f62f2b04d40789e5bdb00f88870c6/users/11d0f234305a4409804698a34218dcb0/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:58.569124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.580589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee31a19-6ac7-444f-9d99-b60e1f4b8830 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.640284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.640969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.641255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.641533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.642267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.643900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.656519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 916/1871] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:46:58.660841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.674227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fd47-4352-4aa5-8b13-0e2971e949e7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.698323 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56fee-ff30-468c-bcf0-b4773ea2cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.702613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56fee-ff30-468c-bcf0-b4773ea2cd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.702613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56fee-ff30-468c-bcf0-b4773ea2cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.702613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56fee-ff30-468c-bcf0-b4773ea2cd2d admin admin] PATH_INFO: `/v3/projects/cb1f62f2b04d40789e5bdb00f88870c6/users/11d0f234305a4409804698a34218dcb0/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.703871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.704055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be56fee-ff30-468c-bcf0-b4773ea2cd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1f62f2b04d40789e5bdb00f88870c6, user_id=11d0f234305a4409804698a34218dcb0, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.705843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:58.707065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be56fee-ff30-468c-bcf0-b4773ea2cd2d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.719972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 956/1872] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:46:58 2022] PUT /identity/v3/projects/cb1f62f2b04d40789e5bdb00f88870c6/users/11d0f234305a4409804698a34218dcb0/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:58.721165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41d7c-de2a-4e6b-8252-2e928e71ef67 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.731990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.732305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.732552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.764650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] MFA Rules not processed for user `11d0f234305a4409804698a34218dcb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:58.767189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:58.797693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:58.812347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.813599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.813727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.814038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] PATH_INFO: `/v3/users/bda6bde2688b44219b7b873f10740630` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.816273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda6bde2688b44219b7b873f10740630)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.819065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.882256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 957/1873] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:46:58.893669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:58.895221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:58.962983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b4a3-8a92-444d-bb87-b76a2b30c4da None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:58.966843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a40149-ba3b-4070-b969-8f1ed1c77466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:58.967512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a40149-ba3b-4070-b969-8f1ed1c77466 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:58.967799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a40149-ba3b-4070-b969-8f1ed1c77466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:58.968079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a40149-ba3b-4070-b969-8f1ed1c77466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:58.978074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a40149-ba3b-4070-b969-8f1ed1c77466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:58.979562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a40149-ba3b-4070-b969-8f1ed1c77466 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:58.993637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 958/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:59.020710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda6bde2688b44219b7b873f10740630'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.104555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda6bde2688b44219b7b873f10740630'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.125242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda6bde2688b44219b7b873f10740630'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.131418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda6bde2688b44219b7b873f10740630'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.144294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda6bde2688b44219b7b873f10740630'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.151514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 917/1875] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:58 2022] DELETE /identity/v3/users/bda6bde2688b44219b7b873f10740630 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:46:59.156025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:59.156499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:59.156579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:59.175085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:59.176402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:59.236396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 959/1876] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:46:59.247364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:59.248893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:59.316338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ab6a-5869-430d-aba2-d320be0f1a67 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:59.322373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4dd7b-159a-41f6-9404-5b9bc48f6313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:59.323717 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4dd7b-159a-41f6-9404-5b9bc48f6313 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:59.324263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4dd7b-159a-41f6-9404-5b9bc48f6313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:59.324787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4dd7b-159a-41f6-9404-5b9bc48f6313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:59.336262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4dd7b-159a-41f6-9404-5b9bc48f6313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:59.337944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4dd7b-159a-41f6-9404-5b9bc48f6313 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:59.348618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 918/1877] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:46:59.555799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:46:59.557436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:46:59.569880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9346ff-3d44-4e62-93cb-41112d1222ed None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:46:59.575255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:46:59.576176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:59.576336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:59.576813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] PATH_INFO: `/v3/users/832a686c9c65429aaa9780e6868f938b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:59.577796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832a686c9c65429aaa9780e6868f938b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:46:59.579754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:46:59.819068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832a686c9c65429aaa9780e6868f938b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.907653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832a686c9c65429aaa9780e6868f938b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.908299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832a686c9c65429aaa9780e6868f938b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.915731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832a686c9c65429aaa9780e6868f938b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.928642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832a686c9c65429aaa9780e6868f938b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:46:59.935263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 960/1878] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:46:59 2022] DELETE /identity/v3/users/832a686c9c65429aaa9780e6868f938b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:46:59.939841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:46:59.940296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:46:59.940407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:46:59.958118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:46:59.959349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.019967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:00.021803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.044567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 919/1879] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:00.044668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd4095-05d6-4a0d-9dfc-ede1e2af5684 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:00.048434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:00.050065 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.056086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:00.063010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.063246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.063524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] PATH_INFO: `/v3/projects/f67d8699443b485bba3807b52f212d87` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.065213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67d8699443b485bba3807b52f212d87)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:00.067548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:00.142810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7991cd-ac89-4913-afad-9807ffdf481b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:00.148322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d0ed-e218-476a-a6bb-8b91a1cd4b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:00.149063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d0ed-e218-476a-a6bb-8b91a1cd4b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.149523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d0ed-e218-476a-a6bb-8b91a1cd4b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.149805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d0ed-e218-476a-a6bb-8b91a1cd4b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.171631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d0ed-e218-476a-a6bb-8b91a1cd4b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:00.173155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d0ed-e218-476a-a6bb-8b91a1cd4b39 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:00.186895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 920/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:00.193751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.193751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.193751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.221003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] MFA Rules not processed for user `8cf59045d9eb4a3d8cf0e0ea57fc7268`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:00.222674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.235275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67d8699443b485bba3807b52f212d87', 'request_id': 'req-aa82a867-f491-405e-b4a8-e9e19340840a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.258180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67d8699443b485bba3807b52f212d87', 'request_id': 'req-aa82a867-f491-405e-b4a8-e9e19340840a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.311195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 921/1881] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:00.315544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:00.317010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.357194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67d8699443b485bba3807b52f212d87', 'request_id': 'req-aa82a867-f491-405e-b4a8-e9e19340840a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.369231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] The token cache is being invalidate because project f67d8699443b485bba3807b52f212d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:00.369646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.371173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.376117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 961/1882] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:00 2022] DELETE /identity/v3/projects/f67d8699443b485bba3807b52f212d87 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:00.377102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:00.384550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.385787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da624fd-f666-4578-b29a-c6ac8c59073a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:00.392227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:00.392398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.392683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.392963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.393662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:00.395694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:00.403424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a867-f491-405e-b4a8-e9e19340840a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:00.411429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:00.418293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.418293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.418293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] PATH_INFO: `/v3/users/62dff48bb2644d6eab03a4d863321caf` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.418293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dff48bb2644d6eab03a4d863321caf)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:00.418293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:00.530782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 922/1883] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:00 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:00.532025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:00.535170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.604872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deaea0-f742-411c-a493-6b90f5f126d5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:00.610354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:00.611384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.612174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.612174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] PATH_INFO: `/v3/users/fb50c15264044732b8dac0b899ea3d6b` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.613379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb50c15264044732b8dac0b899ea3d6b)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:00.615449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:00.710946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dff48bb2644d6eab03a4d863321caf'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.735411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:00.815409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dff48bb2644d6eab03a4d863321caf'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.816399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dff48bb2644d6eab03a4d863321caf'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.828636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dff48bb2644d6eab03a4d863321caf'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.844132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dff48bb2644d6eab03a4d863321caf'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:00.853788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 962/1884] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:00 2022] DELETE /identity/v3/users/62dff48bb2644d6eab03a4d863321caf => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:00.853788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:00.853788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:00.930064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd947f0-b32e-4316-b2f9-30a7c411d900 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:00.935973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:00.936955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:00.936955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:00.937257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:00.939265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:00.940385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:00.972504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb50c15264044732b8dac0b899ea3d6b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.069502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 963/1885] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:00 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:01.074430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.086592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658f9e-9e40-47b3-9f12-3910ef13a462 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.092421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.093186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.093580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.093921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.095000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.096546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.114386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 964/1886] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:01.116383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb50c15264044732b8dac0b899ea3d6b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.116685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.134212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb50c15264044732b8dac0b899ea3d6b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.135107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb50c15264044732b8dac0b899ea3d6b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.139061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e38df-54c6-49be-a86a-f2e1180a6f23 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.147956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b97485c0-705c-4309-b6ed-bde3a71c5cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb50c15264044732b8dac0b899ea3d6b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.148675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.149811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.150254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.150742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] PATH_INFO: `/v3/projects/29e97c0b11494315ad5007eb446a1fbe/users/eadd78bd46814ec0a6b3465e3ec4e6ac/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.157505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 923/1887] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:00 2022] DELETE /identity/v3/users/fb50c15264044732b8dac0b899ea3d6b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:01.161622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.161926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.162226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.178297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e97c0b11494315ad5007eb446a1fbe, user_id=eadd78bd46814ec0a6b3465e3ec4e6ac, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.181520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.186031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:01.187683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.263457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 924/1888] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:01.291214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.293291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.320686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 965/1889] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:01 2022] PUT /identity/v3/projects/29e97c0b11494315ad5007eb446a1fbe/users/eadd78bd46814ec0a6b3465e3ec4e6ac/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:01.337897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.340256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.416067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a550-c219-485f-9092-a230f21f14b4 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.430134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac81e-32c2-469e-93f6-fc5669493df6 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.437437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.438238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.438593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.439180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.440356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.442175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.475865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 966/1890] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:01.477071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.479422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.502241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac31e-808a-43be-a970-ffeebfbb79e5 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.507964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.508817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.509013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.509288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] PATH_INFO: `/v3/projects/349ce8878a934fa8a9cebe48add7b301` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.510849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=349ce8878a934fa8a9cebe48add7b301)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.514048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.540777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.541805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.542151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.543799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.560068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.564452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.577932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 925/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:47:01.578602 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.594078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ee69-438d-4345-9f9a-9c4e667feef9 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.602710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.602710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.602710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.603039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] PATH_INFO: `/v3/projects/29e97c0b11494315ad5007eb446a1fbe/users/eadd78bd46814ec0a6b3465e3ec4e6ac/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.606195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e97c0b11494315ad5007eb446a1fbe, user_id=eadd78bd46814ec0a6b3465e3ec4e6ac, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.613554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.629426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 926/1892] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:01 2022] PUT /identity/v3/projects/29e97c0b11494315ad5007eb446a1fbe/users/eadd78bd46814ec0a6b3465e3ec4e6ac/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:01.630372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.632447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.665903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349ce8878a934fa8a9cebe48add7b301', 'request_id': 'req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.677121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349ce8878a934fa8a9cebe48add7b301', 'request_id': 'req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.736788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd00953-96b9-4661-acb9-47299e72f4e3 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.820839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.822938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.824068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.824664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] PATH_INFO: `/v3/projects/2cd68048a5f7449c957662152b3a16da` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.825998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd68048a5f7449c957662152b3a16da)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.829619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:01.839850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349ce8878a934fa8a9cebe48add7b301', 'request_id': 'req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.863454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] The token cache is being invalidate because project 349ce8878a934fa8a9cebe48add7b301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:01.863812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.875613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0b1ecd28-6b4a-4049-81d9-f43ffbf67e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:01.875613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 967/1893] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:01 2022] DELETE /identity/v3/projects/349ce8878a934fa8a9cebe48add7b301 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:01.879995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d9f93-98c5-4656-a36c-8a4941c328b7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.880285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d9f93-98c5-4656-a36c-8a4941c328b7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.880560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d9f93-98c5-4656-a36c-8a4941c328b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.911145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7d0d9f93-98c5-4656-a36c-8a4941c328b7 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:01.912373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7d0d9f93-98c5-4656-a36c-8a4941c328b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.925773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 968/1894] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:01.934251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.934541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.934850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.953354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:01.954578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:01.963152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 969/1895] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:01.968055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:01.977609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd04446-1dc4-40b2-afd0-f842067ff689 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:01.982922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:01.983636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:01.984059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:01.984345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:01.985100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:01.985411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:01.987067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:02.004284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 970/1896] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:47:02.005135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:02.015744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae551349-6d4d-43d3-9fba-1940026829b1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:02.020368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:02.021024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:02.021307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:02.021584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:02.022302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:02.024233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:02.847377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 971/1897] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:02 2022] POST /identity/v3/projects => generated 387 bytes in 843 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:02.851419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:02.859683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd68048a5f7449c957662152b3a16da', 'request_id': 'req-af1a3e64-6724-45ef-b6ac-1557b6767cf5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:02.866534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd68048a5f7449c957662152b3a16da', 'request_id': 'req-af1a3e64-6724-45ef-b6ac-1557b6767cf5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:02.917637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542ab6-27f7-4bb3-bf9c-b1ce27739093 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:02.922193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:02.922981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:02.923275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:02.923559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:02.924311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:02.926362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:02.998176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd68048a5f7449c957662152b3a16da', 'request_id': 'req-af1a3e64-6724-45ef-b6ac-1557b6767cf5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.013573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] The token cache is being invalidate because project 2cd68048a5f7449c957662152b3a16da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:03.013995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.015356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.017975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 927/1898] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:01 2022] DELETE /identity/v3/projects/2cd68048a5f7449c957662152b3a16da => generated 0 bytes in 1387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:03.018232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:03.019595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:03.040403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 972/1899] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:02 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:03.042827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:03.047926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:03.073092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecaf13-f921-4bd0-8bc5-aa29ad871e65 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:03.079495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:03.080395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.080681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.080959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] PATH_INFO: `/v3/users/0840b3545380459a9bb3aea925a190b4` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.083273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0840b3545380459a9bb3aea925a190b4)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:03.086128 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:03.147395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a3e64-6724-45ef-b6ac-1557b6767cf5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:03.152885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:03.153789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.154075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.154352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] PATH_INFO: `/v3/projects/c6d46c146fe54edbae185964cf79311f` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.156213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d46c146fe54edbae185964cf79311f)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:03.159688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:03.160135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:03.411410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0840b3545380459a9bb3aea925a190b4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.415458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d46c146fe54edbae185964cf79311f', 'request_id': 'req-b8e0d865-3eb3-4a23-b401-000b0dc889de'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.423095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d46c146fe54edbae185964cf79311f', 'request_id': 'req-b8e0d865-3eb3-4a23-b401-000b0dc889de'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.560738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0840b3545380459a9bb3aea925a190b4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.561681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0840b3545380459a9bb3aea925a190b4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.575682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0840b3545380459a9bb3aea925a190b4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.588893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0840b3545380459a9bb3aea925a190b4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.596040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 973/1900] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:03 2022] DELETE /identity/v3/users/0840b3545380459a9bb3aea925a190b4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:03.597586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:03.600251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:03.690107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832be58-d5c0-424c-8cbf-73c53551f0c1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:03.702567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0915c-34dd-446d-ade1-f1e7b98598c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:03.703770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0915c-34dd-446d-ade1-f1e7b98598c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.704737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0915c-34dd-446d-ade1-f1e7b98598c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.705032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0915c-34dd-446d-ade1-f1e7b98598c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.705795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0915c-34dd-446d-ade1-f1e7b98598c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:03.707719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0915c-34dd-446d-ade1-f1e7b98598c1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:03.751218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d46c146fe54edbae185964cf79311f', 'request_id': 'req-b8e0d865-3eb3-4a23-b401-000b0dc889de'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.762547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 974/1901] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:03.762547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c4174-de33-4f4b-b1f7-f930da5b5f53 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.762547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c4174-de33-4f4b-b1f7-f930da5b5f53 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.762547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c4174-de33-4f4b-b1f7-f930da5b5f53 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.765808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] The token cache is being invalidate because project c6d46c146fe54edbae185964cf79311f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:03.766166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.768949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 975/1902] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:47:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:47:03.770109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c4174-de33-4f4b-b1f7-f930da5b5f53 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:03.773059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b8e0d865-3eb3-4a23-b401-000b0dc889de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:03.779462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 928/1903] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:03 2022] DELETE /identity/v3/projects/c6d46c146fe54edbae185964cf79311f => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:03.779462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.779462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.780194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.788194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0a2c4174-de33-4f4b-b1f7-f930da5b5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:03.805375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:03.807075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:03.831341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c4174-de33-4f4b-b1f7-f930da5b5f53 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:03.836987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:03.837677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.838132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.838476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.839881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:03.842054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:03.857278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 976/1904] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:03.858387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:03.860625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:03.878229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803b727-b1b7-4be0-9251-54073eb64794 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:03.883690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:03.884617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.884908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.890577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] PATH_INFO: `/v3/users/11d0f234305a4409804698a34218dcb0` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.890577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d0f234305a4409804698a34218dcb0)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:03.890577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:03.899331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 929/1905] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:47:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:03.900820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:03.915840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7355c-9ae5-4e94-b335-69cc7a135d85 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:03.922811 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53e4c-c426-47e8-893f-e1c4aea811e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:03.923785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53e4c-c426-47e8-893f-e1c4aea811e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:03.924062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53e4c-c426-47e8-893f-e1c4aea811e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:03.924335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53e4c-c426-47e8-893f-e1c4aea811e3 admin admin] PATH_INFO: `/v3/projects/ebcc86c3d1ad447a84bf2f399052fcfa/users/0e8420d5fff44304a2af3481b867ecd9/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:03.941965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f53e4c-c426-47e8-893f-e1c4aea811e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcc86c3d1ad447a84bf2f399052fcfa, user_id=0e8420d5fff44304a2af3481b867ecd9, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:03.944694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f53e4c-c426-47e8-893f-e1c4aea811e3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.036171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 930/1906] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:03 2022] PUT /identity/v3/projects/ebcc86c3d1ad447a84bf2f399052fcfa/users/0e8420d5fff44304a2af3481b867ecd9/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:04.049924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.050225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.051262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.107598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d0f234305a4409804698a34218dcb0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.109396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] MFA Rules not processed for user `0e8420d5fff44304a2af3481b867ecd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:04.110821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:04.203298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d0f234305a4409804698a34218dcb0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.204379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d0f234305a4409804698a34218dcb0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.219156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d0f234305a4409804698a34218dcb0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.255268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d0f234305a4409804698a34218dcb0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.263876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 977/1907] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:03 2022] DELETE /identity/v3/users/11d0f234305a4409804698a34218dcb0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:04.271226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:04.272262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 931/1908] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:04.272446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:04.274004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:04.275837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:04.391297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8462-70b4-4894-ba0e-3e891d27f330 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:04.409887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50dfdd-8d60-4ec4-ad22-7c2c75adc1cd admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:04.416049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:04.416729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.417021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.417361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.420124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:04.434076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:04.441006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.447245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 978/1909] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:04.457710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:04.458444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.458764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.459046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.460162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:04.462224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.498204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:04.499776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:04.519406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b6b0a-e9ed-4fbd-a5e4-2fb7733f7edf service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:04.525649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:04.527813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.527813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.527813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] PATH_INFO: `/v3/projects/eeabed0244954be9af11c9fc8d0d58f8` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.528794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeabed0244954be9af11c9fc8d0d58f8)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:04.531033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.567842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 932/1910] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:04 2022] POST /identity/v3/projects => generated 387 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:04.570354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:04.636878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebd7a0-b90e-4380-9cdb-2a0ad0c16a7f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:04.641737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:04.642471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.642796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.643364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.644261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:04.646481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.663695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeabed0244954be9af11c9fc8d0d58f8', 'request_id': 'req-4c611d82-284b-43c0-b185-b22a62eb4624'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.670898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeabed0244954be9af11c9fc8d0d58f8', 'request_id': 'req-4c611d82-284b-43c0-b185-b22a62eb4624'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.760072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 933/1911] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:04 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:04.762073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:04.782918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb626-6cec-4988-8503-9ebe4573f90e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:04.786425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeabed0244954be9af11c9fc8d0d58f8', 'request_id': 'req-4c611d82-284b-43c0-b185-b22a62eb4624'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.814577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] The token cache is being invalidate because project eeabed0244954be9af11c9fc8d0d58f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:04.820798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.823133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:04.829757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 979/1912] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:04 2022] DELETE /identity/v3/projects/eeabed0244954be9af11c9fc8d0d58f8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:04.830911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:04.832990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:04.911539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:04.936786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611d82-284b-43c0-b185-b22a62eb4624 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:04.943458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:04.943944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5a459-5f9f-4174-aa89-0d6b0b7b5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:04.944782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5a459-5f9f-4174-aa89-0d6b0b7b5797 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.945090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.945506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.945906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] PATH_INFO: `/v3/projects/cb1f62f2b04d40789e5bdb00f88870c6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.946247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5a459-5f9f-4174-aa89-0d6b0b7b5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.946624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5a459-5f9f-4174-aa89-0d6b0b7b5797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:04.947550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5a459-5f9f-4174-aa89-0d6b0b7b5797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:04.947817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1f62f2b04d40789e5bdb00f88870c6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:04.949655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5a459-5f9f-4174-aa89-0d6b0b7b5797 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.950626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:04.972551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 934/1913] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:04.978381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485db74-d5fb-4f34-8704-bd51cb308493 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:04.978806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485db74-d5fb-4f34-8704-bd51cb308493 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:04.979751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485db74-d5fb-4f34-8704-bd51cb308493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.031754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b485db74-d5fb-4f34-8704-bd51cb308493 None None] MFA Rules not processed for user `eadd78bd46814ec0a6b3465e3ec4e6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.032837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b485db74-d5fb-4f34-8704-bd51cb308493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.111834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 935/1914] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:05.116948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1f62f2b04d40789e5bdb00f88870c6', 'request_id': 'req-53f9326a-f783-46e5-afa5-5645aa81958c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:05.125263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.125543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.125774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.127167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1f62f2b04d40789e5bdb00f88870c6', 'request_id': 'req-53f9326a-f783-46e5-afa5-5645aa81958c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:05.158722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.159072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.234108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1f62f2b04d40789e5bdb00f88870c6', 'request_id': 'req-53f9326a-f783-46e5-afa5-5645aa81958c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:05.257998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] The token cache is being invalidate because project cb1f62f2b04d40789e5bdb00f88870c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:05.258311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:05.259819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53f9326a-f783-46e5-afa5-5645aa81958c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:05.264752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 936/1915] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:05.265847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 980/1916] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:04 2022] DELETE /identity/v3/projects/cb1f62f2b04d40789e5bdb00f88870c6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:05.275036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781983d8-fc1d-45c9-bdc9-bf4efe80e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.275394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781983d8-fc1d-45c9-bdc9-bf4efe80e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.275599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781983d8-fc1d-45c9-bdc9-bf4efe80e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.278596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.282228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.301260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccbfb4-2218-4f49-9a41-c883f4543a8c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.303477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-781983d8-fc1d-45c9-bdc9-bf4efe80e5c3 None None] MFA Rules not processed for user `8cf59045d9eb4a3d8cf0e0ea57fc7268`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.304386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e2571-2c26-4064-ba93-81bf1fd9d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.305531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2571-2c26-4064-ba93-81bf1fd9d910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.305817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2571-2c26-4064-ba93-81bf1fd9d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.306122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2571-2c26-4064-ba93-81bf1fd9d910 admin admin] PATH_INFO: `/v3/projects/0739089c4af8441db991fdb36904b512/users/b32ce80c0c8f4bc5849f30701d125598/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.306785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-781983d8-fc1d-45c9-bdc9-bf4efe80e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.323565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e2571-2c26-4064-ba93-81bf1fd9d910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739089c4af8441db991fdb36904b512, user_id=b32ce80c0c8f4bc5849f30701d125598, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.326797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e2571-2c26-4064-ba93-81bf1fd9d910 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.369230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 981/1917] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:05.371124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01925ce-f02f-473a-a517-621799644d5c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.371497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01925ce-f02f-473a-a517-621799644d5c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.371726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01925ce-f02f-473a-a517-621799644d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.395735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c01925ce-f02f-473a-a517-621799644d5c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.398533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c01925ce-f02f-473a-a517-621799644d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.409257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 982/1918] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:05.410891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.411290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.411672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.432880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.434955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.441640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 937/1919] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:05 2022] PUT /identity/v3/projects/0739089c4af8441db991fdb36904b512/users/b32ce80c0c8f4bc5849f30701d125598/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:05.444177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.446254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.446979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.500778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.503050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.511896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 983/1920] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:05.511896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.530982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb39145-1002-477b-8f5d-77fb092c6d97 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.535425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 938/1921] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:05.535425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.535425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.550644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.552896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.553126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.553802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.554421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.556063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.569429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 984/1922] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:05.570782 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.583380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88796721-9e34-4a15-9d7b-bfd1d8e8c21e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.588455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.589897 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.590789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.590789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.591499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:05.592082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.593789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.606202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 985/1923] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:05.610871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.622413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bee57-ab4b-45ab-9abb-7f2a2b7a97a2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.627119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89a63-be57-4b36-9de4-826d6e927a9d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.627327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.628003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.628557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.628844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.629587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:05.629892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.631520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.632211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.632952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.633436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.635418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.636881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.647652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 986/1924] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:05.648624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.661311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59195e-4fda-4bec-99b0-9e4f2b2a4344 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.666326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.667200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.667665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.668247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] PATH_INFO: `/v3/projects/0739089c4af8441db991fdb36904b512/users/b32ce80c0c8f4bc5849f30701d125598/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.670865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739089c4af8441db991fdb36904b512, user_id=b32ce80c0c8f4bc5849f30701d125598, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.673668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.687710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 987/1925] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:05 2022] PUT /identity/v3/projects/0739089c4af8441db991fdb36904b512/users/b32ce80c0c8f4bc5849f30701d125598/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:05.688362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.710179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:05.722088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.723634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.732775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 939/1926] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:05.733371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:05.743518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd402d-73f5-40ca-a688-a3814ad20055 service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.761653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce24d-a55a-42cb-9294-ca35cbf585b3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:05.768157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516baee-0623-46ae-b428-bb82d968cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.768955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516baee-0623-46ae-b428-bb82d968cab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.769245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516baee-0623-46ae-b428-bb82d968cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.769520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516baee-0623-46ae-b428-bb82d968cab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.770219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516baee-0623-46ae-b428-bb82d968cab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.772203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516baee-0623-46ae-b428-bb82d968cab1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.824856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:05.825709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.826090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.826368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.827105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:05.829061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:05.893187 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 988/1927] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:05.894054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:05.894346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:05.894727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:05.925582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] MFA Rules not processed for user `b32ce80c0c8f4bc5849f30701d125598`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:05.927279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:05.953614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 940/1928] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:05.953614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.030824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 989/1929] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:06.031742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.040457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5c2e-2f38-46c5-bbe4-7b7898f1fdc4 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.047863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.048554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.048836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.049114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.049891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.052165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.108581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faefc-5e86-47d3-a104-8690b256bc00 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.113465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.114278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.114652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.115025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.115793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.118158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.164245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 941/1930] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:05 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:06.164245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.164245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:06.250145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0f7f-b636-45a3-b9a7-f3a338522a64 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.257107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 990/1931] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:06 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:06.258120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.263628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.265843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.266919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.267980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.277836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6647c2f-38d8-49a5-be3e-334fd407a7a9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.286067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.286067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.286339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.286644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.287523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.290254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.304564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 991/1932] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:06.305438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.314114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:06.318625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c7ec-21fd-4b1d-a7f2-0304ade6668d admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.324619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.325507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.325809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.326476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.327359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.331249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.354411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 992/1933] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:06.356525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.369214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdc76d-0bac-41e6-befc-2b0f4c36560b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.376551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.377968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.378183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.378466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.379844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.381500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.398134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 993/1934] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:06.398134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.411488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e7189-3150-467e-93fc-5fb9748bb4ab admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.414191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.416303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.416562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.417321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.418298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.418593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.419467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.421133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.433261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 994/1935] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:06.434607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.436836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 942/1936] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:06.437694 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.445574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e0bc4-ea3c-4bb9-9055-a7d648f38305 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.449615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea721b1d-f4d5-4a82-b238-80b4a5bafb49 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.451258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e9b3c-5386-45e4-8be6-6c9ccca8e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.452395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e9b3c-5386-45e4-8be6-6c9ccca8e4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.452798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e9b3c-5386-45e4-8be6-6c9ccca8e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.453085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e9b3c-5386-45e4-8be6-6c9ccca8e4a0 admin admin] PATH_INFO: `/v3/projects/a6cc626dae8a41a6bcf22cf1f8b0d27e/users/ac6d819b6d884e86957ee643bc30539e/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.456332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decd230-90c6-48e8-a590-041619c942bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.458316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd230-90c6-48e8-a590-041619c942bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.458947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd230-90c6-48e8-a590-041619c942bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.459313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd230-90c6-48e8-a590-041619c942bc admin admin] PATH_INFO: `/v3/projects/729ea441f72b4cb18c303078418fa19d/users/9203527889724cb2bf40a29095c5e4d7/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.477858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decd230-90c6-48e8-a590-041619c942bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=729ea441f72b4cb18c303078418fa19d, user_id=9203527889724cb2bf40a29095c5e4d7, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.494401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decd230-90c6-48e8-a590-041619c942bc admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.502256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e9b3c-5386-45e4-8be6-6c9ccca8e4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cc626dae8a41a6bcf22cf1f8b0d27e, user_id=ac6d819b6d884e86957ee643bc30539e, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.514807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e9b3c-5386-45e4-8be6-6c9ccca8e4a0 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.575797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 943/1937] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:06 2022] PUT /identity/v3/projects/729ea441f72b4cb18c303078418fa19d/users/9203527889724cb2bf40a29095c5e4d7/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:06.585855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.587872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.588983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.609476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 995/1938] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:06 2022] PUT /identity/v3/projects/a6cc626dae8a41a6bcf22cf1f8b0d27e/users/ac6d819b6d884e86957ee643bc30539e/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:06.620064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.620356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.620859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.660965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] MFA Rules not processed for user `9203527889724cb2bf40a29095c5e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:06.662220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:06.685360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] MFA Rules not processed for user `ac6d819b6d884e86957ee643bc30539e`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:06.686382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:06.793486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 944/1939] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:06.794437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.797350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:06.819819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 996/1940] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:06.822469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:06.876315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6c97-c88f-48cc-827b-27e342fc9c5e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.883028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.883925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.884213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.884884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] PATH_INFO: `/v3/users/0e8420d5fff44304a2af3481b867ecd9` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.885735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8420d5fff44304a2af3481b867ecd9)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.887775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:06.927002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3295998-c7ca-45b0-9886-9adf34273dbe None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:06.931765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:06.932538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:06.932825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:06.933796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:06.934615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:06.936562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.027684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:07.038655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 997/1941] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:06 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:07.038655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.092390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d6f7-c868-456d-9e51-d8dfbea51938 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.096104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.096753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.097100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.097380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.099268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8420d5fff44304a2af3481b867ecd9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.165728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.167668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.177284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 998/1942] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:07.178077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.219671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8420d5fff44304a2af3481b867ecd9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.232830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8420d5fff44304a2af3481b867ecd9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.233471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8420d5fff44304a2af3481b867ecd9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.240108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8420d5fff44304a2af3481b867ecd9'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.242061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1a627-ab16-4d28-ba29-7abce4ff6eb9 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.246665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 945/1943] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:06 2022] DELETE /identity/v3/users/0e8420d5fff44304a2af3481b867ecd9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:07.249750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d54e0-dc77-46a9-8325-98681f5dcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.249750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d54e0-dc77-46a9-8325-98681f5dcdeb admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.249750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d54e0-dc77-46a9-8325-98681f5dcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.249750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d54e0-dc77-46a9-8325-98681f5dcdeb admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.250202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d54e0-dc77-46a9-8325-98681f5dcdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.250423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.250835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d54e0-dc77-46a9-8325-98681f5dcdeb admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.251904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.322456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85654-f008-451a-a8f6-2c434dc26ef2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.327469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.328344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.328623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.328977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] PATH_INFO: `/v3/users/9203527889724cb2bf40a29095c5e4d7` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.330156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9203527889724cb2bf40a29095c5e4d7)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.332092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.343170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 999/1944] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:07 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:07.344539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.344834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.345114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.363645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:07.364856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.373805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1000/1945] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:07.374779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.375964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.388067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4077c-de94-45c3-8c7b-b2949134afbd None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.392926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.393654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.393938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.394212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.394979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.396577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.409818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1001/1946] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:07.409818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.411352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.471446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c7268-e1f0-4d7f-b45f-ebe25b457a82 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.476237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.476997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.477214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.477475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.487830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.489272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.499438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1002/1947] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:07.500224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.509785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cee52-afba-4215-84c8-8288caef2b44 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.515678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.517283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.517283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.517583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] PATH_INFO: `/v3/projects/1b97cabaee4c459d96f43a76e9e2855f/users/b1932b67ead84e92b633712d18cf53fd/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.542702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b97cabaee4c459d96f43a76e9e2855f, user_id=b1932b67ead84e92b633712d18cf53fd, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.545652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.577507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9203527889724cb2bf40a29095c5e4d7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.665525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1003/1948] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:07 2022] PUT /identity/v3/projects/1b97cabaee4c459d96f43a76e9e2855f/users/b1932b67ead84e92b633712d18cf53fd/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:07.669701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.706309 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9203527889724cb2bf40a29095c5e4d7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.724275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9203527889724cb2bf40a29095c5e4d7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.725149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9203527889724cb2bf40a29095c5e4d7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.736036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-cc0fd71e-19a1-421d-8f48-338528efe85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9203527889724cb2bf40a29095c5e4d7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:07.743980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 946/1949] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:07 2022] DELETE /identity/v3/users/9203527889724cb2bf40a29095c5e4d7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:07.748255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be1af5-8ce5-4a31-b034-467abca28128 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.750097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.750764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.751241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.773132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:07.790360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.897871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.907037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.907326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.907614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.908407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.910374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.922582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1004/1950] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:07.927249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.929107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.943951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 947/1951] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:07.947970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724bc9-2f2c-4ddf-957f-868cd235c013 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:07.960600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:07.962356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:07.964048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3df97-7eb3-4899-ac42-fbc9176a0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:07.967848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3df97-7eb3-4899-ac42-fbc9176a0698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:07.967848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3df97-7eb3-4899-ac42-fbc9176a0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:07.967848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3df97-7eb3-4899-ac42-fbc9176a0698 admin admin] PATH_INFO: `/v3/projects/1b97cabaee4c459d96f43a76e9e2855f/users/b1932b67ead84e92b633712d18cf53fd/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:07.968235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3df97-7eb3-4899-ac42-fbc9176a0698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b97cabaee4c459d96f43a76e9e2855f, user_id=b1932b67ead84e92b633712d18cf53fd, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:07.971535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3df97-7eb3-4899-ac42-fbc9176a0698 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:07.987776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1005/1952] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:07 2022] PUT /identity/v3/projects/1b97cabaee4c459d96f43a76e9e2855f/users/b1932b67ead84e92b633712d18cf53fd/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:08.006733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:08.007195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:08.007623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:08.067486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79e9cc-2274-404e-b7cf-04211c0f4752 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:08.100653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] MFA Rules not processed for user `b1932b67ead84e92b633712d18cf53fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:08.107127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:08.163070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:08.163742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:08.164031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:08.164320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:08.219447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1006/1953] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:08.222242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:08.224973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:08.274966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:08.276630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:08.285718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:08.293525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 948/1954] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:08.295164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:08.296870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:08.327191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31884698-3575-4916-ab7d-3610cbb0a6b1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:08.333431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:08.334829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:08.334975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:08.335155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] PATH_INFO: `/v3/projects/ebcc86c3d1ad447a84bf2f399052fcfa` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:08.336513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcc86c3d1ad447a84bf2f399052fcfa)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:08.338842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:08.391914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839100b-9053-4c79-94ce-e980f735412d service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:08.395810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:08.396465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:08.396749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:08.397023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:08.398926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:08.461729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcc86c3d1ad447a84bf2f399052fcfa', 'request_id': 'req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:08.466991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:08.468537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:08.469513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcc86c3d1ad447a84bf2f399052fcfa', 'request_id': 'req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:08.478155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 949/1955] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:08.580354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcc86c3d1ad447a84bf2f399052fcfa', 'request_id': 'req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:08.597877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] The token cache is being invalidate because project ebcc86c3d1ad447a84bf2f399052fcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:08.598290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:08.601723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:08.610778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1007/1956] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:08 2022] DELETE /identity/v3/projects/ebcc86c3d1ad447a84bf2f399052fcfa => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:08.614742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:08.633091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341add-6e63-48d0-b78a-fcc7f85c70fc service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:08.729746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:08.731351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:08.731941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:08.731941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] PATH_INFO: `/v3/users/b32ce80c0c8f4bc5849f30701d125598` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:08.733174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32ce80c0c8f4bc5849f30701d125598)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:08.735231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:08.921377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:08.922950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:08.938404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef5ed-0103-42bb-a416-570a9bd1e07b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:08.943779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:08.944656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:08.944944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:08.945226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] PATH_INFO: `/v3/projects/729ea441f72b4cb18c303078418fa19d` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:08.946450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=729ea441f72b4cb18c303078418fa19d)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:08.948395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:08.974795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32ce80c0c8f4bc5849f30701d125598'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.074163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32ce80c0c8f4bc5849f30701d125598'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.092562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32ce80c0c8f4bc5849f30701d125598'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.092701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32ce80c0c8f4bc5849f30701d125598'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.101951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-648c0b16-3dcc-436a-bda7-26224a848f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32ce80c0c8f4bc5849f30701d125598'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.106371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729ea441f72b4cb18c303078418fa19d', 'request_id': 'req-e3544da0-b325-4076-a032-10637dc513ce'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.112652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 950/1957] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:08 2022] DELETE /identity/v3/users/b32ce80c0c8f4bc5849f30701d125598 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:09.119453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729ea441f72b4cb18c303078418fa19d', 'request_id': 'req-e3544da0-b325-4076-a032-10637dc513ce'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.123342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:09.250439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729ea441f72b4cb18c303078418fa19d', 'request_id': 'req-e3544da0-b325-4076-a032-10637dc513ce'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.262298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] The token cache is being invalidate because project 729ea441f72b4cb18c303078418fa19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:09.262585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.263247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e3544da0-b325-4076-a032-10637dc513ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.264819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1008/1958] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:08 2022] DELETE /identity/v3/projects/729ea441f72b4cb18c303078418fa19d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:09.269907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:09.270367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:09.270456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:09.292001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:09.294176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:09.369174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 951/1959] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:09.378953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:09.379245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:09.387653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:09.426418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:09.428081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:09.452172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1009/1960] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:09.456644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:09.472647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f1d36-fc6e-4a6e-a717-81d916696393 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:09.477953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:09.479352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:09.480490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:09.480650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:09.481485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:09.481860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:09.483616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:09.502386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 952/1961] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:09.508044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:09.524409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8ef7-fa84-41d0-bebd-2189f04542f8 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:09.541898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:09.541898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:09.541898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:09.541898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:09.542197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:09.560031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:09.698063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:09.700816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:09.716367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feced7a0-5476-4cfe-ad45-a676a642df1e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:09.722027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:09.723024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:09.723197 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:09.723464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] PATH_INFO: `/v3/projects/0739089c4af8441db991fdb36904b512` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:09.724642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0739089c4af8441db991fdb36904b512)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:09.726598 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:09.748241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1010/1962] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:09 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:09.755116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:09.822265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7bcf3-e364-41d1-95c2-7066e4ab2663 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:09.827310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:09.827992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:09.828274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:09.828548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:09.829240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:09.831185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:09.887672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0739089c4af8441db991fdb36904b512', 'request_id': 'req-30890189-3a8f-411d-893b-ce888b49671c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.899673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0739089c4af8441db991fdb36904b512', 'request_id': 'req-30890189-3a8f-411d-893b-ce888b49671c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:09.959850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1011/1963] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:09 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:09.963713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:09.973802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b2130-2073-4f4e-973b-b440461197b3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:09.982651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0739089c4af8441db991fdb36904b512', 'request_id': 'req-30890189-3a8f-411d-893b-ce888b49671c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:10.000158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] The token cache is being invalidate because project 0739089c4af8441db991fdb36904b512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:10.000446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:10.001111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30890189-3a8f-411d-893b-ce888b49671c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:10.006266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 953/1964] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:09 2022] DELETE /identity/v3/projects/0739089c4af8441db991fdb36904b512 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:10.007911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.008203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.008480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.028446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:10.030023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:10.053354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.054028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.054308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.054580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.055387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.056972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.068195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1012/1965] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:10.071804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.073711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:10.088058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8943c-ad9c-4b6f-ae92-2a0801ee7709 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.093592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d4867-f2f0-470a-bb24-d01e4ab1d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.094395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d4867-f2f0-470a-bb24-d01e4ab1d589 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.095482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d4867-f2f0-470a-bb24-d01e4ab1d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.095482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d4867-f2f0-470a-bb24-d01e4ab1d589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.096305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d4867-f2f0-470a-bb24-d01e4ab1d589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.098217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d4867-f2f0-470a-bb24-d01e4ab1d589 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.109644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 954/1966] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:10.112923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1013/1967] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:10.114010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.116775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.117209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.117573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.126192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff628b91-3c13-4422-883d-fd6f469e02ef None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.131701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fb7a7-a58d-40b8-8add-e895d2a257f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.132899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb7a7-a58d-40b8-8add-e895d2a257f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.136792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb7a7-a58d-40b8-8add-e895d2a257f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.136792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb7a7-a58d-40b8-8add-e895d2a257f5 admin admin] PATH_INFO: `/v3/projects/bdf4737050e74825b0a6b532c5514c3b/users/4632c309c9124a12a8be6152631eac2a/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.147446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:10.148892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:10.149961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fb7a7-a58d-40b8-8add-e895d2a257f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf4737050e74825b0a6b532c5514c3b, user_id=4632c309c9124a12a8be6152631eac2a, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.153236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fb7a7-a58d-40b8-8add-e895d2a257f5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.158343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1014/1968] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:10.162630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.172721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537d0b-52e6-4573-8d6a-110a74f6fa2e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.177450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.178089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.178367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.178639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.179445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:10.179749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.181341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.193896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1015/1969] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:47:10.198080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.208672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba7dc7-1fa6-4ca5-8ed2-dd5aa0058299 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.213474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.214133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.214450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.214763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.215450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.217398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.317489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 955/1970] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:10 2022] PUT /identity/v3/projects/bdf4737050e74825b0a6b532c5514c3b/users/4632c309c9124a12a8be6152631eac2a/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:10.329239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.329622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.329903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.357942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] MFA Rules not processed for user `4632c309c9124a12a8be6152631eac2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:10.359193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:10.375859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1016/1971] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:10.379918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.448671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 956/1972] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:10.456567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a846b-7d2d-441c-99d9-4ed3dceaf852 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.460919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.461484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.462258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.462566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:10.462668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.463000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.463774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.466916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.550083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b50ae-efa4-4fe9-aa08-17d7f81c5c90 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.597627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.598339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.598621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.598928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.615981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1017/1973] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:10.617421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.627978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321831a-716c-40a3-9585-b5b1e9ba69e1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.632782 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.633444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.633721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.633996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.634845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.636640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.647890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1018/1974] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:10.657957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.670826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.672374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.674490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72999ae8-304d-4bd6-aaee-1b8fe1d7a993 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.680355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648679-3281-4a60-b6d7-e4ff00352992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.681047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648679-3281-4a60-b6d7-e4ff00352992 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.681353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648679-3281-4a60-b6d7-e4ff00352992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.681631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648679-3281-4a60-b6d7-e4ff00352992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.684064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648679-3281-4a60-b6d7-e4ff00352992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.685296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 957/1975] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:47:10.685466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648679-3281-4a60-b6d7-e4ff00352992 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.698566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1019/1976] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:10.702652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:10.714293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242c1d-d15c-403c-8489-40bfc37ffc72 service glance] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:10.720064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:10.721052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.721254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.721529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] PATH_INFO: `/v3/projects/1d7f34454d734afca66fe1aeed713fe3/users/cd7d896ba939480fb5a38f720f870a02/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.739429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f34454d734afca66fe1aeed713fe3, user_id=cd7d896ba939480fb5a38f720f870a02, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:10.743087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:10.767632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:10.830334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 958/1977] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:10 2022] PUT /identity/v3/projects/1d7f34454d734afca66fe1aeed713fe3/users/cd7d896ba939480fb5a38f720f870a02/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:10.841852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:10.842159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:10.842430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:10.845967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:10.872647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] MFA Rules not processed for user `cd7d896ba939480fb5a38f720f870a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:10.873862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:10.943748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1020/1978] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:10.948343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:11.049427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441510-4c83-408c-ad3f-d2bf93b597c4 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:11.054164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:11.054864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.055146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.055418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.056124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:11.058059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:11.196957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 959/1979] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:11.197966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:11.209470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c89c4-24d1-4eff-8290-8be3f6968464 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:11.272155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:11.272946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.273294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.273637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.274425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:11.276483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:11.409667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1021/1980] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:11 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:11.411152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:11.424071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f7ac5-b428-4de6-8eff-5a4c249218de admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:11.429084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:11.429894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.430182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.435624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.435624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:11.435624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:11.447559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 960/1981] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:11.449246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:11.459710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ade53-45e7-42a1-b884-586a843b0d0b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:11.466245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82538801-8580-43db-b675-639e6b84764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:11.467528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82538801-8580-43db-b675-639e6b84764f admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.467528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82538801-8580-43db-b675-639e6b84764f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.467528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82538801-8580-43db-b675-639e6b84764f admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.470172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82538801-8580-43db-b675-639e6b84764f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:11.470172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82538801-8580-43db-b675-639e6b84764f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:11.483273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1022/1982] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:11.487396 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:11.502123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:11.509420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c149e9-3eaa-45b2-8447-712ae8d20f0e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:11.518608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:11.521227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.521227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.521227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] PATH_INFO: `/v3/projects/93e60faeed464f39af1f18b177b9e72f/users/839f29b22d1a47c7a943d0b97d82cefc/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.548810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e60faeed464f39af1f18b177b9e72f, user_id=839f29b22d1a47c7a943d0b97d82cefc, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:11.553707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:11.664021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 961/1983] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:11 2022] PUT /identity/v3/projects/93e60faeed464f39af1f18b177b9e72f/users/839f29b22d1a47c7a943d0b97d82cefc/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:11.675322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.675615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.675906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.712121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] MFA Rules not processed for user `839f29b22d1a47c7a943d0b97d82cefc`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:11.713403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:11.823234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1023/1984] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:11.828238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:11.914336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f128e0-6db9-4f08-adc2-6170f8c2e269 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:11.919879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:11.920554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:11.920838 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:11.921122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:11.921815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:11.923758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.022668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 962/1985] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:11 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:12.022982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:12.035241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e75a0-0028-481a-9d9d-fee71616e4bb None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:12.096778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:12.097454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.097734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.098008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.098728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:12.100650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.209112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1024/1986] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:12 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:12.213179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:12.224338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70571be3-2c27-43c2-b6bb-cd0b756534e8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:12.228983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:12.229865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.230065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.230311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.231129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:12.232730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.243860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 963/1987] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:12.247988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:12.258108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584a9d-a7d5-4839-9681-13e49ceff857 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:12.263530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:12.264539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.264823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.265103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] PATH_INFO: `/v3/projects/09bc6834945443f4b81939ae93a91697/users/6e1107a1ba4d40639b36c771f6c1dddc/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.281007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bc6834945443f4b81939ae93a91697, user_id=6e1107a1ba4d40639b36c771f6c1dddc, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:12.283934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.382103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1025/1988] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:12 2022] PUT /identity/v3/projects/09bc6834945443f4b81939ae93a91697/users/6e1107a1ba4d40639b36c771f6c1dddc/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:12.386722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:12.410460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b29f4-d6d4-40a1-87f0-e40fd95622d1 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:12.482657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79ade-315e-4ea6-bff5-cdf18aa39a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:12.484317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79ade-315e-4ea6-bff5-cdf18aa39a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.484613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79ade-315e-4ea6-bff5-cdf18aa39a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.484897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79ade-315e-4ea6-bff5-cdf18aa39a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.486016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79ade-315e-4ea6-bff5-cdf18aa39a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:12.487815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79ade-315e-4ea6-bff5-cdf18aa39a37 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.502272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 964/1989] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:12.507045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:12.520444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3518b9-d037-4633-ab3b-9f3bbfe9e32c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:12.525766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:12.527297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.527861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.528427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] PATH_INFO: `/v3/projects/09bc6834945443f4b81939ae93a91697/users/6e1107a1ba4d40639b36c771f6c1dddc/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.530577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bc6834945443f4b81939ae93a91697, user_id=6e1107a1ba4d40639b36c771f6c1dddc, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:12.533325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.546222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1026/1990] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:12 2022] PUT /identity/v3/projects/09bc6834945443f4b81939ae93a91697/users/6e1107a1ba4d40639b36c771f6c1dddc/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:12.557473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.557759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.558059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.596887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] MFA Rules not processed for user `6e1107a1ba4d40639b36c771f6c1dddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:12.598194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:12.679969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 965/1991] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:12.693756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:12.696252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:12.776225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01d413-4e27-434c-8c02-409bab8b60c5 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:12.781198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:12.782114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:12.782471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:12.782925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:12.846254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:12.847735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:12.857791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1027/1992] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:12.936425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:13.748426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:14.832293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:16.258986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:16.260520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:16.278381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74189b9-90e3-4fcf-bc70-bfb636e6f539 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:16.285148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:16.286835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:16.287451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:16.288082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:16.290751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:16.383586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:16.383586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:16.400071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 966/1993] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:16.428076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:16.444980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471eec-dd07-4e42-bf34-e7ad3cf082f5 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:16.451115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:16.452363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:16.452861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:16.453775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:16.550046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:16.552169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:16.564952 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1028/1994] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:16.729202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:16.908627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:18.666785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:18.676927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c36fb-7d00-4058-bca0-f7c8fe0582db service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:18.681345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd8a43-bf71-45ff-9209-65bf40812b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:18.682127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd8a43-bf71-45ff-9209-65bf40812b80 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:18.682478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd8a43-bf71-45ff-9209-65bf40812b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:18.682863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd8a43-bf71-45ff-9209-65bf40812b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:18.694438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd8a43-bf71-45ff-9209-65bf40812b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:18.696010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd8a43-bf71-45ff-9209-65bf40812b80 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:18.711550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 967/1995] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:19.549004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:20.240168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:21.817319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:23.594817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:23.803049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:23.804572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:23.817162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:23.871390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3bb0e-870e-46f1-b88c-46d37722eb76 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:23.876272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:23.877164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:23.877537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:23.877854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] PATH_INFO: `/v3/users/ac6d819b6d884e86957ee643bc30539e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:23.879180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6d819b6d884e86957ee643bc30539e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:23.881094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:24.115674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6d819b6d884e86957ee643bc30539e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:24.193798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6d819b6d884e86957ee643bc30539e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:24.194424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6d819b6d884e86957ee643bc30539e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:24.201879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6d819b6d884e86957ee643bc30539e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:24.213571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6d819b6d884e86957ee643bc30539e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:24.219856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1029/1996] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:23 2022] DELETE /identity/v3/users/ac6d819b6d884e86957ee643bc30539e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:24.224535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:24.224864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:24.225154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:24.243662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:24.244848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:24.304391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 968/1997] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:24.315865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:24.317298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:24.464280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08706a4-506d-42b7-81b1-6d6a729714a8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:24.469030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:24.469679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:24.469963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:24.470239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:24.481475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:24.482971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:24.501039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1030/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:24.750062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:24.752538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:24.768527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daae9a-fce1-4903-887d-543ad42eb996 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:24.790262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:24.791193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:24.791483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:24.791763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] PATH_INFO: `/v3/users/cd7d896ba939480fb5a38f720f870a02` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:24.792970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7d896ba939480fb5a38f720f870a02)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:24.795444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:25.088731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7d896ba939480fb5a38f720f870a02'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.171694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:25.176784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:25.176986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7d896ba939480fb5a38f720f870a02'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.189860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c34ba-a0c7-4f39-b945-c4206e674d27 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:25.192481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7d896ba939480fb5a38f720f870a02'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.193265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7d896ba939480fb5a38f720f870a02'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.201853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:25.203621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:25.205027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f468b390-0424-4988-8d1d-b2d375f41f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7d896ba939480fb5a38f720f870a02'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.205597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:25.205924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] PATH_INFO: `/v3/projects/a6cc626dae8a41a6bcf22cf1f8b0d27e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:25.209145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cc626dae8a41a6bcf22cf1f8b0d27e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:25.213622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 969/1999] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:24 2022] DELETE /identity/v3/users/cd7d896ba939480fb5a38f720f870a02 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:25.213987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:25.227529 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:25.227826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:25.228106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:25.248477 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:25.249712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:25.308607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 970/2000] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:25.326441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:25.328056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:25.385572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cc626dae8a41a6bcf22cf1f8b0d27e', 'request_id': 'req-73a5113b-bb11-46f6-9855-3101dc66f4c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.393752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd646-57dd-47b5-a3b8-f409b758a4fa None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:25.393967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cc626dae8a41a6bcf22cf1f8b0d27e', 'request_id': 'req-73a5113b-bb11-46f6-9855-3101dc66f4c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.448425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:25.449307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:25.449593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:25.449866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:25.515490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:25.516852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:25.526672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 971/2001] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:47:25.535082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cc626dae8a41a6bcf22cf1f8b0d27e', 'request_id': 'req-73a5113b-bb11-46f6-9855-3101dc66f4c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.548488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] The token cache is being invalidate because project a6cc626dae8a41a6bcf22cf1f8b0d27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:25.548900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.549894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.552309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1031/2002] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:25 2022] DELETE /identity/v3/projects/a6cc626dae8a41a6bcf22cf1f8b0d27e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:25.556532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:25.559000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:25.575862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287a58-345e-4059-831c-348ab6d1e243 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:25.581495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:25.582440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:25.587192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:25.587192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] PATH_INFO: `/v3/users/b1932b67ead84e92b633712d18cf53fd` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:25.587192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1932b67ead84e92b633712d18cf53fd)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:25.587192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:25.814409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1932b67ead84e92b633712d18cf53fd'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.915106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1932b67ead84e92b633712d18cf53fd'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.928964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1932b67ead84e92b633712d18cf53fd'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.929698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1932b67ead84e92b633712d18cf53fd'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.937627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1932b67ead84e92b633712d18cf53fd'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:25.944440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 972/2003] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:25 2022] DELETE /identity/v3/users/b1932b67ead84e92b633712d18cf53fd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:26.007526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:26.012161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:26.030207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5113b-bb11-46f6-9855-3101dc66f4c1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:26.132783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:26.133992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:26.134366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:26.134752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] PATH_INFO: `/v3/projects/1d7f34454d734afca66fe1aeed713fe3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:26.136363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7f34454d734afca66fe1aeed713fe3)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:26.138876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:26.279655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7f34454d734afca66fe1aeed713fe3', 'request_id': 'req-bbd5e4d8-69b5-428e-a086-083c1bc33453'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.288596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7f34454d734afca66fe1aeed713fe3', 'request_id': 'req-bbd5e4d8-69b5-428e-a086-083c1bc33453'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.376072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7f34454d734afca66fe1aeed713fe3', 'request_id': 'req-bbd5e4d8-69b5-428e-a086-083c1bc33453'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.394534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] The token cache is being invalidate because project 1d7f34454d734afca66fe1aeed713fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:26.395053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.395899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.398786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1032/2004] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:26 2022] DELETE /identity/v3/projects/1d7f34454d734afca66fe1aeed713fe3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:26.402363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:26.405417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:26.427802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a75ea-90e2-4127-b744-73118dfde688 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:26.488656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:26.489533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:26.489813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:26.490084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] PATH_INFO: `/v3/users/839f29b22d1a47c7a943d0b97d82cefc` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:26.491303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839f29b22d1a47c7a943d0b97d82cefc)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:26.493499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:26.500913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:26.554103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:26.555905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:26.579877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5e4d8-69b5-428e-a086-083c1bc33453 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:26.584814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:26.585691 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:26.585975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:26.586251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] PATH_INFO: `/v3/projects/1b97cabaee4c459d96f43a76e9e2855f` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:26.587517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b97cabaee4c459d96f43a76e9e2855f)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:26.589444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:26.689824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:26.777621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b97cabaee4c459d96f43a76e9e2855f', 'request_id': 'req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.779153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839f29b22d1a47c7a943d0b97d82cefc'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.787887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b97cabaee4c459d96f43a76e9e2855f', 'request_id': 'req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.840558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839f29b22d1a47c7a943d0b97d82cefc'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.854761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839f29b22d1a47c7a943d0b97d82cefc'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.855510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839f29b22d1a47c7a943d0b97d82cefc'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.865685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ce680ae8-a19c-41d5-ba44-64e0eaab7ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839f29b22d1a47c7a943d0b97d82cefc'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.872331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 973/2005] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:26 2022] DELETE /identity/v3/users/839f29b22d1a47c7a943d0b97d82cefc => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:26.915469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b97cabaee4c459d96f43a76e9e2855f', 'request_id': 'req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.933901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] The token cache is being invalidate because project 1b97cabaee4c459d96f43a76e9e2855f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:26.934423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.935812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4d3f46aa-bbcd-4d21-b3b8-3df6f8958f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:26.937360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1033/2006] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:26 2022] DELETE /identity/v3/projects/1b97cabaee4c459d96f43a76e9e2855f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:26.943617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:26.943910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:26.944192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:26.963056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:26.964322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:27.027674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 974/2007] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:27.036436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.036753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.037032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.056173 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:27.057329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:27.066780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1034/2008] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:27.070737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.080615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8794ae-3a5c-4773-b73d-755d15d8b375 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.085777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.086334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.086623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.086940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.087677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:27.088006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.090193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.109167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 975/2009] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:27.112016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.132205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821059-e077-4ac1-a34a-eafbe7fcec00 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.140058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.140058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.140058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.140058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.140642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.141895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.269078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1035/2010] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:27 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:27.273310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.285306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e6ad-40af-4d97-b612-70bd1d264398 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.351200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.351952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.352248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.352513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.353217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.355385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.393494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.396214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:27.410576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cac47-a5c7-47dd-9ddd-42c8295ea02c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.423862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.425514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.425885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.426288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] PATH_INFO: `/v3/projects/93e60faeed464f39af1f18b177b9e72f` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.427797 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e60faeed464f39af1f18b177b9e72f)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.430268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.445026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 976/2011] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:27 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:27.449090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.463558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72414-f2a5-4f58-98df-7ea6ded38cc0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.470060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.470996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.471268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.471539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.472272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.473894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.486273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 977/2012] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:27.490255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.501934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfb3c5-cf9a-4452-a36c-98574b089679 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.507524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.508285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.508740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.509023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.509788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.511682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.524163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 978/2013] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:27.528403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.544988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff849f-a80d-4221-b5ac-ceb83502b09e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.551547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dd0fa-cc57-4215-ae60-87671475334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.552654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dd0fa-cc57-4215-ae60-87671475334c admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.552939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dd0fa-cc57-4215-ae60-87671475334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.553215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dd0fa-cc57-4215-ae60-87671475334c admin admin] PATH_INFO: `/v3/projects/24984b790ba1471e9dffe42f56c13a44/users/4e0e3617c7c14bd5a35fb914f0eaebb2/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.574662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dd0fa-cc57-4215-ae60-87671475334c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24984b790ba1471e9dffe42f56c13a44, user_id=4e0e3617c7c14bd5a35fb914f0eaebb2, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.579363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dd0fa-cc57-4215-ae60-87671475334c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.600339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e60faeed464f39af1f18b177b9e72f', 'request_id': 'req-aec91ebc-362c-4471-afba-87a95ec361a0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:27.607794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e60faeed464f39af1f18b177b9e72f', 'request_id': 'req-aec91ebc-362c-4471-afba-87a95ec361a0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:27.683335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e60faeed464f39af1f18b177b9e72f', 'request_id': 'req-aec91ebc-362c-4471-afba-87a95ec361a0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:27.690931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 979/2014] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:27 2022] PUT /identity/v3/projects/24984b790ba1471e9dffe42f56c13a44/users/4e0e3617c7c14bd5a35fb914f0eaebb2/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:27.698522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] The token cache is being invalidate because project 93e60faeed464f39af1f18b177b9e72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:27.698904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:27.699633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:27.702287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1036/2015] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:27 2022] DELETE /identity/v3/projects/93e60faeed464f39af1f18b177b9e72f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:27.702780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c015-520e-418a-affc-c5981167b464 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.703138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c015-520e-418a-affc-c5981167b464 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.703421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c015-520e-418a-affc-c5981167b464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.705871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.707547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:27.751401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-0032c015-520e-418a-affc-c5981167b464 None None] MFA Rules not processed for user `4e0e3617c7c14bd5a35fb914f0eaebb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:27.752786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0032c015-520e-418a-affc-c5981167b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:27.786000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec91ebc-362c-4471-afba-87a95ec361a0 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.831424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 980/2016] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:27.843925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c015-520e-418a-affc-c5981167b464 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:27.845186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.845323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0032c015-520e-418a-affc-c5981167b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:27.846339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.846710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.849928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] PATH_INFO: `/v3/users/6e1107a1ba4d40639b36c771f6c1dddc` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.851419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1107a1ba4d40639b36c771f6c1dddc)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.853488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.907073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c015-520e-418a-affc-c5981167b464 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:27.910856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:27.911794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:27.912259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:27.912929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:27.922124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:27.923704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:27.933457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 981/2017] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:47:28.061324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1107a1ba4d40639b36c771f6c1dddc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:28.228783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1107a1ba4d40639b36c771f6c1dddc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:28.266853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1107a1ba4d40639b36c771f6c1dddc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:28.266853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1107a1ba4d40639b36c771f6c1dddc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:28.266853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c09397ee-02d0-48d6-bd52-b11f80c95289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1107a1ba4d40639b36c771f6c1dddc'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:28.266853 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1037/2018] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:27 2022] DELETE /identity/v3/users/6e1107a1ba4d40639b36c771f6c1dddc => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:28.761483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:28.811862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:28.960369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:28.984348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bbdb5-a275-45df-b442-edfab090a745 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.052760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.053843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.054132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.054410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] PATH_INFO: `/v3/projects/09bc6834945443f4b81939ae93a91697` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.055653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bc6834945443f4b81939ae93a91697)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.057564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:29.176456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bc6834945443f4b81939ae93a91697', 'request_id': 'req-38e433b1-d7f9-4ff2-8774-baf558122b96'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:29.182528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bc6834945443f4b81939ae93a91697', 'request_id': 'req-38e433b1-d7f9-4ff2-8774-baf558122b96'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:29.308257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bc6834945443f4b81939ae93a91697', 'request_id': 'req-38e433b1-d7f9-4ff2-8774-baf558122b96'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:29.320249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] The token cache is being invalidate because project 09bc6834945443f4b81939ae93a91697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:29.320539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:29.321169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-38e433b1-d7f9-4ff2-8774-baf558122b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:29.322793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 982/2019] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:28 2022] DELETE /identity/v3/projects/09bc6834945443f4b81939ae93a91697 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:29.329379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.329860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.334439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.348435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:29.349649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:29.408856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1038/2020] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:29.416946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.417237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.417525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.437959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:29.439311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:29.447607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 983/2021] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:29.452113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:29.466336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337317a-7227-43e9-90f4-3be79ac60ab3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.467329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.468059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.468348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.468659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.469427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:29.469825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.471519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:29.484121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1039/2022] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:29.488567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:29.498960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815f59-6307-471b-92a2-594b3aef2e6e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.503791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.504773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.504773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.505235 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.505810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.507809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:29.614744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 984/2023] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:29 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:29.618550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:29.629578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fece9-8e69-4be3-9317-662118046117 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.694410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.695127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.695412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.695692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.696399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.698342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:29.827945 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1040/2024] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:29 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:29.832109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:29.843111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264273-7e1f-486d-80e4-6fe98fbedbb1 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.847703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.848379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.848647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.848922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.849648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.851269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:29.861810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 985/2025] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:29.867608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:29.878122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02535-b643-43f1-b4e9-d62361fe374a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.882986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67584934-957c-40d8-9205-d795a4e94394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.883662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67584934-957c-40d8-9205-d795a4e94394 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.883950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67584934-957c-40d8-9205-d795a4e94394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.884230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67584934-957c-40d8-9205-d795a4e94394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.884970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67584934-957c-40d8-9205-d795a4e94394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.886563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67584934-957c-40d8-9205-d795a4e94394 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:29.897094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1041/2026] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:29.902574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:29.915361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8ff-df37-45ed-9e09-abdd40d62451 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:29.921036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:29.922054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:29.922240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:29.922512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] PATH_INFO: `/v3/projects/7d9e72b3a2d44dea92e5479451d54f19/users/f31abd32ccae4dd39a3c220b969aff06/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:29.938614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9e72b3a2d44dea92e5479451d54f19, user_id=f31abd32ccae4dd39a3c220b969aff06, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:29.941383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:30.039802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 986/2027] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:29 2022] PUT /identity/v3/projects/7d9e72b3a2d44dea92e5479451d54f19/users/f31abd32ccae4dd39a3c220b969aff06/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:30.050271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec149-bd6e-4332-8658-53625047ede2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:30.050585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec149-bd6e-4332-8658-53625047ede2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:30.050907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec149-bd6e-4332-8658-53625047ede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:30.079250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fecec149-bd6e-4332-8658-53625047ede2 None None] MFA Rules not processed for user `f31abd32ccae4dd39a3c220b969aff06`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:30.080567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fecec149-bd6e-4332-8658-53625047ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:30.114888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:30.146502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1042/2028] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:30.158930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:30.160714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:30.220902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751aace-6efa-49e8-ba6a-6a20daefc7d8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:30.224676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:30.225363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:30.225648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:30.225925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:30.234382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:30.235847 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:30.244971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 987/2029] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:30.981103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:32.155330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:33.314634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:33.509438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:33.509707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:33.510175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:33.530592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] MFA Rules not processed for user `f31abd32ccae4dd39a3c220b969aff06`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:33.532082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:33.550159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1043/2030] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:34.245268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:35.153109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:35.403019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:35.689271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:35.689271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:35.754059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1df652-a761-4375-a429-2092ed767497 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:35.758606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:35.759491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:35.759776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:35.760050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] PATH_INFO: `/v3/users/5c6586cbd05e4b49b8ff44b09bc7d51f` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:35.761266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6586cbd05e4b49b8ff44b09bc7d51f)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:35.763250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:36.065470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6586cbd05e4b49b8ff44b09bc7d51f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.171759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6586cbd05e4b49b8ff44b09bc7d51f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.184900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6586cbd05e4b49b8ff44b09bc7d51f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.185778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6586cbd05e4b49b8ff44b09bc7d51f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.193303 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6586cbd05e4b49b8ff44b09bc7d51f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.199367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 988/2031] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:35 2022] DELETE /identity/v3/users/5c6586cbd05e4b49b8ff44b09bc7d51f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:36.338674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:36.340167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:36.352872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaad28-2bc4-4029-8146-1a8363441b43 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:36.411192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:36.411909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:36.412375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:36.412923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:36.414814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:36.486652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:36.488118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87157a95-15be-4ccb-84a0-1640f49d87ab service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:36.498612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1044/2032] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:36.563600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:36.565134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:36.652115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc284c-1d53-4298-b99d-6e90c8975019 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:36.657898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:36.658978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:36.659389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:36.659541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] PATH_INFO: `/v3/projects/24eafbd2d9fa4e13a0a379dc9d2ea36e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:36.660733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24eafbd2d9fa4e13a0a379dc9d2ea36e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:36.662639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:36.823232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24eafbd2d9fa4e13a0a379dc9d2ea36e', 'request_id': 'req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.829693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24eafbd2d9fa4e13a0a379dc9d2ea36e', 'request_id': 'req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.908457 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24eafbd2d9fa4e13a0a379dc9d2ea36e', 'request_id': 'req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.921500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] The token cache is being invalidate because project 24eafbd2d9fa4e13a0a379dc9d2ea36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:36.921870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.922518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-bfea7db6-d3c6-4e04-af5b-72b118ae2a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:36.924194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 989/2033] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:36 2022] DELETE /identity/v3/projects/24eafbd2d9fa4e13a0a379dc9d2ea36e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:36.929319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:36.929720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:36.930120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:36.949270 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:36.950460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:37.010898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1045/2034] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:37.020020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.020307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.020584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.039061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:37.040258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:37.049175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 990/2035] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:37.053578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.064707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65cc68-72cf-48f4-9927-1d0698faebe3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.069427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.070144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.070494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.070875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.071685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:37.071991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.073595 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:37.086822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1046/2036] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:37.090566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.100919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c2ff6-9978-4a3b-8939-66084df22dd1 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.105777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.106438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.106748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.108122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.108830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.110987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:37.250861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 991/2037] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:37 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:37.254590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.265807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5c9a-7ea3-470b-a1b3-ee7723f3a99c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.330254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.330899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.331185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.331454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.332176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.334152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:37.417912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:37.461916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.464036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1047/2038] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:37 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:37.478401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad81c9-5576-4d42-9f44-d4b51fee9a08 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.484084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.484948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.485307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.485587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.486715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.488446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:37.509837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 992/2039] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:37.514446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.525335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee77f1-1f8a-453a-8e7d-9af0a5e78425 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.533046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13229fcc-7f1b-43f5-ae55-a8d6ee590464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.533990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13229fcc-7f1b-43f5-ae55-a8d6ee590464 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.534581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13229fcc-7f1b-43f5-ae55-a8d6ee590464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.535761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13229fcc-7f1b-43f5-ae55-a8d6ee590464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.537015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13229fcc-7f1b-43f5-ae55-a8d6ee590464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.538835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13229fcc-7f1b-43f5-ae55-a8d6ee590464 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:37.574451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1048/2040] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:37.579673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.597324 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9c10-51dc-4e30-bcfb-288eb04a6441 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.604348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.605331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.605613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.605892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] PATH_INFO: `/v3/projects/78a29a850e3746a8970048c946f32ec0/users/251bb33f64a447ca91c07bab7eeea707/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.626179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a29a850e3746a8970048c946f32ec0, user_id=251bb33f64a447ca91c07bab7eeea707, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.636460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:37.702061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:37.709325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 993/2041] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:37 2022] PUT /identity/v3/projects/78a29a850e3746a8970048c946f32ec0/users/251bb33f64a447ca91c07bab7eeea707/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:37.720069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.720360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.720639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.750075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] MFA Rules not processed for user `251bb33f64a447ca91c07bab7eeea707`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:37.751299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:37.839781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1049/2042] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:37.842358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:37.912353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50ac01-4d20-4c23-b2e4-846df11120d7 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:37.919400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:37.920895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:37.921256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:37.921588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:37.922427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:37.924385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.062731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 994/2043] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:37 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:38.066880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:38.077837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7703b3-4133-47d2-9cbc-aaeac411ebc3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:38.133741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:38.134393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.134675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.134981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.135678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:38.137605 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.322127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1050/2044] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:38 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:38.328282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:38.343553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706852c-2cab-4a7b-971f-969bc77f55fa admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:38.358463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:38.359332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.359954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.360251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.361072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:38.363036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.384123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 995/2045] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:38.387334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:38.398854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1a36-e1f8-4dba-a980-ff4aacc6df16 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:38.408152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:38.409598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.410109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.411198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] PATH_INFO: `/v3/projects/77f812deff994ef89bede624fe558510/users/222c46621e274ffca864c25eee747220/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.433388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f812deff994ef89bede624fe558510, user_id=222c46621e274ffca864c25eee747220, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:38.437262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.513846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1051/2046] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:38 2022] PUT /identity/v3/projects/77f812deff994ef89bede624fe558510/users/222c46621e274ffca864c25eee747220/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:38.518152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:38.532273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf1c8-b91a-4276-a0cc-e50d7d6f998a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:38.600074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174496d-479f-4462-8e91-a60717c25a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:38.600828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174496d-479f-4462-8e91-a60717c25a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.601141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174496d-479f-4462-8e91-a60717c25a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.601419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174496d-479f-4462-8e91-a60717c25a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.602198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174496d-479f-4462-8e91-a60717c25a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:38.604040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174496d-479f-4462-8e91-a60717c25a94 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.614351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 996/2047] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:38.619023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:38.630456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a20b3e-167d-40d0-b7fa-1d775d5a4b1c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:38.635759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:38.640211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.640211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.640211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] PATH_INFO: `/v3/projects/77f812deff994ef89bede624fe558510/users/222c46621e274ffca864c25eee747220/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.640578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f812deff994ef89bede624fe558510, user_id=222c46621e274ffca864c25eee747220, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:38.643535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.655735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1052/2048] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:38 2022] PUT /identity/v3/projects/77f812deff994ef89bede624fe558510/users/222c46621e274ffca864c25eee747220/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:38.666339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.666651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.666986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.721710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] MFA Rules not processed for user `222c46621e274ffca864c25eee747220`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:38.723076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:38.798702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 997/2049] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:38.810848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:38.812721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:38.873799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c19d9-62fb-4ca8-a849-3ae935ee31d7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:38.878162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1a4fc-4ba8-42b4-870c-fd4700cc5005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:38.878979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1a4fc-4ba8-42b4-870c-fd4700cc5005 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:38.879199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1a4fc-4ba8-42b4-870c-fd4700cc5005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:38.879468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1a4fc-4ba8-42b4-870c-fd4700cc5005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:38.891822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1a4fc-4ba8-42b4-870c-fd4700cc5005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:38.893347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1a4fc-4ba8-42b4-870c-fd4700cc5005 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:38.907751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1053/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:39.290175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:39.819499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:40.095908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:40.158385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5afdee-9da3-4c9c-8121-2517b7be96f5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:40.163310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:40.164161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:40.164440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:40.164827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] PATH_INFO: `/v3/users/251bb33f64a447ca91c07bab7eeea707` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:40.166034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251bb33f64a447ca91c07bab7eeea707)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:40.168131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:40.406873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251bb33f64a447ca91c07bab7eeea707'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:40.472312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251bb33f64a447ca91c07bab7eeea707'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:40.486558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251bb33f64a447ca91c07bab7eeea707'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:40.487312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251bb33f64a447ca91c07bab7eeea707'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:40.494802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251bb33f64a447ca91c07bab7eeea707'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:40.504872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 998/2051] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:40 2022] DELETE /identity/v3/users/251bb33f64a447ca91c07bab7eeea707 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:40.506748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:40.507185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:40.507321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:40.527861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:40.529232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:40.592385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1054/2052] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:40.612390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:40.614079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:40.698633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4f23-b4ce-4fc4-b269-b00290cb8695 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:40.708526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:40.708526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:40.708526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:40.708526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:40.717472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:40.719275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:40.754095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 999/2053] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:41.095920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:41.690435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:41.692355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:41.723459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd4f32-2728-47b7-a11e-25e114048f99 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:41.732293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:41.733659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:41.734113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:41.734392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] PATH_INFO: `/v3/projects/78a29a850e3746a8970048c946f32ec0` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:41.735905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a29a850e3746a8970048c946f32ec0)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:41.738157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:41.869628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a29a850e3746a8970048c946f32ec0', 'request_id': 'req-62c52f8c-68d1-4746-9395-349524b8cb5f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:41.882895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a29a850e3746a8970048c946f32ec0', 'request_id': 'req-62c52f8c-68d1-4746-9395-349524b8cb5f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.012386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a29a850e3746a8970048c946f32ec0', 'request_id': 'req-62c52f8c-68d1-4746-9395-349524b8cb5f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.026123 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] The token cache is being invalidate because project 78a29a850e3746a8970048c946f32ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:42.026537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.027544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.029576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1055/2054] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:41 2022] DELETE /identity/v3/projects/78a29a850e3746a8970048c946f32ec0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:42.033835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:42.043655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f84c7-840a-4ff2-888b-beb0fc4f528e service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:42.076470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:42.104912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:42.106052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:42.106543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:42.107000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] PATH_INFO: `/v3/users/222c46621e274ffca864c25eee747220` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:42.110389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222c46621e274ffca864c25eee747220)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:42.111845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:42.349389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:42.450092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222c46621e274ffca864c25eee747220'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.529573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222c46621e274ffca864c25eee747220'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.542615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222c46621e274ffca864c25eee747220'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.543343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222c46621e274ffca864c25eee747220'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.554225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5b8713e6-7428-464c-8190-b352cc023dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222c46621e274ffca864c25eee747220'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:42.556583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1000/2055] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:42 2022] DELETE /identity/v3/users/222c46621e274ffca864c25eee747220 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:43.084834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:43.086006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:43.103748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c52f8c-68d1-4746-9395-349524b8cb5f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:43.166415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:43.167244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:43.167528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:43.167803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] PATH_INFO: `/v3/projects/77f812deff994ef89bede624fe558510` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:43.168996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f812deff994ef89bede624fe558510)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:43.171242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:43.321127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f812deff994ef89bede624fe558510', 'request_id': 'req-10fec842-9e83-404e-904e-ec2a363f1a5e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:43.328515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f812deff994ef89bede624fe558510', 'request_id': 'req-10fec842-9e83-404e-904e-ec2a363f1a5e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:43.485048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f812deff994ef89bede624fe558510', 'request_id': 'req-10fec842-9e83-404e-904e-ec2a363f1a5e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:43.508983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] The token cache is being invalidate because project 77f812deff994ef89bede624fe558510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:43.509275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:43.510089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-10fec842-9e83-404e-904e-ec2a363f1a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:43.514870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1056/2056] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:43 2022] DELETE /identity/v3/projects/77f812deff994ef89bede624fe558510 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:43.520101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:43.520572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:43.520856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:43.547252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:43.548463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:43.639842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1001/2057] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:43.648613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:43.648985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:43.649443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:43.670946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:43.672175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:43.680462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1057/2058] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:43.684796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:43.695370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098feed1-b6bf-4e30-91c4-c4961a1226b5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:43.700127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:43.704359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:43.704359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:43.704359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:43.704359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:43.704359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:43.704784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:43.716228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1002/2059] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:43.720487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:43.729688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f0e1-f58c-4170-8a94-a06d827c7439 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:43.735461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:43.736118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:43.736403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:43.736680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:43.737411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:43.739412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:43.755447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:43.842892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1058/2060] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:43 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:43.847127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:43.860077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c45d-2586-4ff7-90be-30e85a1fa9d6 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:43.923922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:43.924662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:43.924951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:43.925228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:43.925943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:43.927973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.047194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1003/2061] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:43 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:44.051241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.061407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd227-5955-4ca7-9346-d645cdbdacc8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.065918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.066575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.066891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.067171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.067907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.069504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.082780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1059/2062] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:44.083951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.095023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c235904-bf5a-406c-a0bd-13ca0d227d0e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.099824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d57d-9fc4-45b2-8ede-0c84049c2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.100494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d57d-9fc4-45b2-8ede-0c84049c2094 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.100789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d57d-9fc4-45b2-8ede-0c84049c2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.101070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d57d-9fc4-45b2-8ede-0c84049c2094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.101904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d57d-9fc4-45b2-8ede-0c84049c2094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.103574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d57d-9fc4-45b2-8ede-0c84049c2094 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.115019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1004/2063] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:44.119539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.130145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcc85-b210-4298-baac-1afd66c46db8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.134812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.135698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.136006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.136297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] PATH_INFO: `/v3/projects/f8cf2888aaa04e7698b50f11e030912a/users/080512cedb4640f4bcbec005e6a93cfa/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.150939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cf2888aaa04e7698b50f11e030912a, user_id=080512cedb4640f4bcbec005e6a93cfa, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.153677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.155880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:44.309899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1060/2064] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:44 2022] PUT /identity/v3/projects/f8cf2888aaa04e7698b50f11e030912a/users/080512cedb4640f4bcbec005e6a93cfa/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:44.320608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.320899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.321179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.350740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] MFA Rules not processed for user `080512cedb4640f4bcbec005e6a93cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:44.352091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:44.429343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1005/2065] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:44.434349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.500577 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21e1e-5e01-4df6-aed8-1646804eefab admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.505575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.506365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.506655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.506961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.507656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.509685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.606539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1061/2066] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:44 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:44.607769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.619974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86e737-8ba2-410b-9e32-02b81f936c69 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.705259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.706170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.706460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.706825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.707764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.709932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.835818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1006/2067] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:44 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:44.840107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.852647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57357b87-3a8d-4d54-813e-cd6198c77248 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.857872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.858591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.858924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.859209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.859963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.861916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:44.874285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1062/2068] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:44.878643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:44.890397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32866fa1-d1fb-4b63-be0b-8375507bf3bb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:44.895778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:44.896832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:44.897192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:44.897530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] PATH_INFO: `/v3/projects/d793a225866a4948a691af7812a0cc38/users/0eeaf761735844f595d0de0f903b1e7a/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:44.914648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d793a225866a4948a691af7812a0cc38, user_id=0eeaf761735844f595d0de0f903b1e7a, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:44.917662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:45.024198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1007/2069] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:44 2022] PUT /identity/v3/projects/d793a225866a4948a691af7812a0cc38/users/0eeaf761735844f595d0de0f903b1e7a/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:45.028326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:45.040058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d2bb-ef8d-4e6b-a6c8-038d80bdbb8b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:45.111100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b44b3b-e0a1-4cdd-a61b-ed888ac18f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:45.111818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44b3b-e0a1-4cdd-a61b-ed888ac18f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:45.112104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44b3b-e0a1-4cdd-a61b-ed888ac18f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:45.112384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44b3b-e0a1-4cdd-a61b-ed888ac18f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:45.113121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b44b3b-e0a1-4cdd-a61b-ed888ac18f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:45.114743 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b44b3b-e0a1-4cdd-a61b-ed888ac18f68 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:45.127885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1063/2070] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:45.130955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:45.144578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9b2dd-fd68-4177-8218-7d23a40ac7f1 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:45.151117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:45.152088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:45.152434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:45.152877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] PATH_INFO: `/v3/projects/d793a225866a4948a691af7812a0cc38/users/0eeaf761735844f595d0de0f903b1e7a/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:45.156286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d793a225866a4948a691af7812a0cc38, user_id=0eeaf761735844f595d0de0f903b1e7a, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:45.158990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:45.170481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1008/2071] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:45 2022] PUT /identity/v3/projects/d793a225866a4948a691af7812a0cc38/users/0eeaf761735844f595d0de0f903b1e7a/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:45.181644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:45.181945 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:45.182228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:45.210000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] MFA Rules not processed for user `0eeaf761735844f595d0de0f903b1e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:45.211322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:45.280193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1064/2072] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:45.291834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:45.293690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:45.363129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024a320-635f-475d-9e80-42996e2c4514 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:45.366955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:45.367860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:45.368148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:45.368701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:45.379310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:45.380834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:45.392423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1009/2073] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:45.631523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:45.634629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:45.646016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e47b79-aaef-4908-84ca-a107726c417d None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:45.649785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50acb4-1f98-43e0-a023-18508cdd5dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:45.650438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50acb4-1f98-43e0-a023-18508cdd5dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:45.650749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50acb4-1f98-43e0-a023-18508cdd5dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:45.651033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50acb4-1f98-43e0-a023-18508cdd5dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:45.711336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50acb4-1f98-43e0-a023-18508cdd5dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:45.712933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50acb4-1f98-43e0-a023-18508cdd5dd3 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:45.723242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1065/2074] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:45.907777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:46.332464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:47.761442 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:49.147795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:49.149279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:49.215260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02fcd5-9581-4569-9ee3-53a3b8d9c77b service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:49.219945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:49.220822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:49.221116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:49.221398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] PATH_INFO: `/v3/users/4e0e3617c7c14bd5a35fb914f0eaebb2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:49.222652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0e3617c7c14bd5a35fb914f0eaebb2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:49.225581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:49.517547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0e3617c7c14bd5a35fb914f0eaebb2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:49.649989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0e3617c7c14bd5a35fb914f0eaebb2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:49.662424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0e3617c7c14bd5a35fb914f0eaebb2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:49.663125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0e3617c7c14bd5a35fb914f0eaebb2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:49.670569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0e3617c7c14bd5a35fb914f0eaebb2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:49.676839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1010/2075] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:49 2022] DELETE /identity/v3/users/4e0e3617c7c14bd5a35fb914f0eaebb2 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:49.681181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:49.681643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:49.681858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:49.690533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:49.704083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:49.705302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:49.768468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1066/2076] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:49.776813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:49.778369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:49.843274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d4386-f8d5-4978-820f-e3c1b98d85ef admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:49.846894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072399f-09fb-4d7e-8a90-1fec7b5c13da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:49.847546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072399f-09fb-4d7e-8a90-1fec7b5c13da service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:49.847948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072399f-09fb-4d7e-8a90-1fec7b5c13da service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:49.848249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072399f-09fb-4d7e-8a90-1fec7b5c13da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:49.857888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072399f-09fb-4d7e-8a90-1fec7b5c13da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:49.859352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072399f-09fb-4d7e-8a90-1fec7b5c13da service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:49.870232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1011/2077] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:50.053733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:50.533198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:50.534887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:50.563832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8c082-0c55-4deb-a9f9-e05d5587ebff None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:50.570312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:50.571220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:50.571502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:50.571773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] PATH_INFO: `/v3/projects/24984b790ba1471e9dffe42f56c13a44` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:50.573542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24984b790ba1471e9dffe42f56c13a44)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:50.575546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:50.708376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24984b790ba1471e9dffe42f56c13a44', 'request_id': 'req-a10dc27b-3271-4155-9534-6f3eb8e52e8c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:50.715319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24984b790ba1471e9dffe42f56c13a44', 'request_id': 'req-a10dc27b-3271-4155-9534-6f3eb8e52e8c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:50.829328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24984b790ba1471e9dffe42f56c13a44', 'request_id': 'req-a10dc27b-3271-4155-9534-6f3eb8e52e8c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:50.840507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] The token cache is being invalidate because project 24984b790ba1471e9dffe42f56c13a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:50.840800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:50.841433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a10dc27b-3271-4155-9534-6f3eb8e52e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:50.844176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1067/2078] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:50 2022] DELETE /identity/v3/projects/24984b790ba1471e9dffe42f56c13a44 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:50.849157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:50.849607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:50.849722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:50.869959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:50.874094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:50.931082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1012/2079] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:50.939286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:50.939582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:50.939859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:50.959265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:50.960477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:50.970371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1068/2080] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:50.973940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:50.984427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45fd5-263e-4ea4-9739-f462a56c6c5c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:50.989231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:50.989895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:50.990305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:50.990455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:50.994631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:50.995019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:50.996663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.012456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1013/2081] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:51.015650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.025116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d499107-ef90-4d86-a459-f0e052cedc20 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.030342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.031038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.031320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.031590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.032281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.034165 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.206184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:51.224117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1069/2082] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:51 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:51.224484 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.247092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9080-3561-487d-8052-c2636f03de26 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.313169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.313905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.314193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.314486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.315221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.317215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.424270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1014/2083] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:51 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:51.428297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.439815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba8cc-c3bc-4e00-91a5-5a0c4fc69d57 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.445009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.445688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.445974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.446249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.447075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.452984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.463082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1070/2084] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:51.464714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.476187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf31cd1-0bdc-4411-8f92-0542c8e0f29f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.481229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.482206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.483141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.483430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.484305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.485990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.496573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1015/2085] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:51.501124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.511002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095b438-481a-4093-b13b-9f4c22467b80 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.515594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c7f9d-6982-47c8-8874-5a1b303d8942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.516468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c7f9d-6982-47c8-8874-5a1b303d8942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.516752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c7f9d-6982-47c8-8874-5a1b303d8942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.517042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c7f9d-6982-47c8-8874-5a1b303d8942 admin admin] PATH_INFO: `/v3/projects/17c4b8223f2c4b19baead8f9eb55c234/users/b5bb625bf1264a6bb127537b6b811fb8/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.520878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:51.532101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c7f9d-6982-47c8-8874-5a1b303d8942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c4b8223f2c4b19baead8f9eb55c234, user_id=b5bb625bf1264a6bb127537b6b811fb8, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.534838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c7f9d-6982-47c8-8874-5a1b303d8942 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.594897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.596698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:51.610846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5870-8de4-4bac-ad61-6ccbe4caa422 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.616190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.616461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.616798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.617081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] PATH_INFO: `/v3/users/4632c309c9124a12a8be6152631eac2a` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.618570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4632c309c9124a12a8be6152631eac2a)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.620587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.642184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1071/2086] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:51 2022] PUT /identity/v3/projects/17c4b8223f2c4b19baead8f9eb55c234/users/b5bb625bf1264a6bb127537b6b811fb8/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:51.652821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.653186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.653561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.682938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] MFA Rules not processed for user `b5bb625bf1264a6bb127537b6b811fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:51.684232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:51.763264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1072/2087] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:51.884693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:51.886654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:51.893339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4632c309c9124a12a8be6152631eac2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:51.949316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b638-d244-49e2-a6ee-28a1848fed85 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:51.953739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6f3ee-102f-4b4a-8256-18ab15a81d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:51.954393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f3ee-102f-4b4a-8256-18ab15a81d3e service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:51.954680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f3ee-102f-4b4a-8256-18ab15a81d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:51.954991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f3ee-102f-4b4a-8256-18ab15a81d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:51.963630 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6f3ee-102f-4b4a-8256-18ab15a81d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:51.967687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6f3ee-102f-4b4a-8256-18ab15a81d3e service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:51.975064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1073/2088] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:51.986983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4632c309c9124a12a8be6152631eac2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.000144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4632c309c9124a12a8be6152631eac2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.000874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4632c309c9124a12a8be6152631eac2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.007655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4632c309c9124a12a8be6152631eac2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.014118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1016/2089] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:51 2022] DELETE /identity/v3/users/4632c309c9124a12a8be6152631eac2a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:52.018863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:52.019162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:52.019441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:52.039598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:52.040861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:52.053443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:52.055000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:52.118305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1074/2090] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:52.127118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:52.128637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:52.129755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097cb4-3287-46ef-8df5-2141d5074f03 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:52.135919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:52.136708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:52.137316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:52.137316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] PATH_INFO: `/v3/users/080512cedb4640f4bcbec005e6a93cfa` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:52.138783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080512cedb4640f4bcbec005e6a93cfa)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:52.141483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:52.190540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64873-283a-48f2-83c0-ea408a737933 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:52.194683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fa0fb-8ae4-4e95-bfbc-217889a52578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:52.195382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa0fb-8ae4-4e95-bfbc-217889a52578 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:52.195658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa0fb-8ae4-4e95-bfbc-217889a52578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:52.195935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa0fb-8ae4-4e95-bfbc-217889a52578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:52.206061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fa0fb-8ae4-4e95-bfbc-217889a52578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:52.207530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fa0fb-8ae4-4e95-bfbc-217889a52578 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:52.217618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1075/2091] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:52.428498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080512cedb4640f4bcbec005e6a93cfa'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.458772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:52.532403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080512cedb4640f4bcbec005e6a93cfa'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.543524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080512cedb4640f4bcbec005e6a93cfa'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.544433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080512cedb4640f4bcbec005e6a93cfa'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.553684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080512cedb4640f4bcbec005e6a93cfa'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.560465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1017/2092] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:52 2022] DELETE /identity/v3/users/080512cedb4640f4bcbec005e6a93cfa => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:52.566008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:52.566371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:52.566649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:52.594670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:52.595963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:52.673526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1076/2093] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:52.683594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:52.685035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:52.743667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:52.745025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb423f-ebb7-44c8-927d-c29adb490357 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:52.745159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:52.748817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8bf69-1e0b-40db-87f8-ba7da270ce42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:52.749473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8bf69-1e0b-40db-87f8-ba7da270ce42 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:52.749759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8bf69-1e0b-40db-87f8-ba7da270ce42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:52.750062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8bf69-1e0b-40db-87f8-ba7da270ce42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:52.761146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8bf69-1e0b-40db-87f8-ba7da270ce42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:52.763015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8bf69-1e0b-40db-87f8-ba7da270ce42 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:52.764849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9b092-7eaf-45e6-abc1-8f3501b45791 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:52.770373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:52.771140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:52.771831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:52.771831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] PATH_INFO: `/v3/projects/bdf4737050e74825b0a6b532c5514c3b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:52.773251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf4737050e74825b0a6b532c5514c3b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:52.775352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:52.781671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1018/2094] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:47:52.978602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf4737050e74825b0a6b532c5514c3b', 'request_id': 'req-f26c82d8-f130-464a-b30a-083475b17a36'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:52.984967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf4737050e74825b0a6b532c5514c3b', 'request_id': 'req-f26c82d8-f130-464a-b30a-083475b17a36'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.115142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf4737050e74825b0a6b532c5514c3b', 'request_id': 'req-f26c82d8-f130-464a-b30a-083475b17a36'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.127774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] The token cache is being invalidate because project bdf4737050e74825b0a6b532c5514c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:53.128069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.128735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f26c82d8-f130-464a-b30a-083475b17a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.130446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1077/2095] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:52 2022] DELETE /identity/v3/projects/bdf4737050e74825b0a6b532c5514c3b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:53.135410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b2342-4514-474e-8adf-32a35b98383b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.135868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b2342-4514-474e-8adf-32a35b98383b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.135975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b2342-4514-474e-8adf-32a35b98383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.154092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-296b2342-4514-474e-8adf-32a35b98383b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:53.155364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-296b2342-4514-474e-8adf-32a35b98383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:53.225102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1019/2096] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:53.235041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.235335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.235613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.254819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:53.256042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:53.264515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1078/2097] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:53.268903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b2342-4514-474e-8adf-32a35b98383b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.278935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b2342-4514-474e-8adf-32a35b98383b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.283666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.284341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.284651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.285102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.285895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:53.286234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.287926 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.299590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.301025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:53.307928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1020/2098] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:47:53.309034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.321965 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d250-9358-4a63-a495-b703999f8f4d None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.325723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06736618-6666-42a7-93ea-633440e82888 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.328295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.329320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.329602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.330265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] PATH_INFO: `/v3/projects/f8cf2888aaa04e7698b50f11e030912a` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.331107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cf2888aaa04e7698b50f11e030912a)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.332126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.333106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.333248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.333345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.333610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.334500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.337416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.499463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1021/2099] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:53 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:53.503615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.516390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cf2888aaa04e7698b50f11e030912a', 'request_id': 'req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.524037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cf2888aaa04e7698b50f11e030912a', 'request_id': 'req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.567444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1252f-165d-4c25-a7dd-5f91984de389 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.572101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.572775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.573060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.573344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.574044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.576008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.604669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cf2888aaa04e7698b50f11e030912a', 'request_id': 'req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.616208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] The token cache is being invalidate because project f8cf2888aaa04e7698b50f11e030912a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:53.616498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.617151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:53.619037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1079/2100] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:53 2022] DELETE /identity/v3/projects/f8cf2888aaa04e7698b50f11e030912a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:53.622803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.625164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:53.628127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:53.695257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a678f-22af-4f8c-92e3-d659a6e7e5e9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.696813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.697690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.697976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.698253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] PATH_INFO: `/v3/users/0eeaf761735844f595d0de0f903b1e7a` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.699503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eeaf761735844f595d0de0f903b1e7a)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.702184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.748641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1022/2101] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:53 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:47:53.752712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.754411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:53.767213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a59a19-d9ef-4456-ab1a-8add4c52ce48 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.772092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.772861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.773153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.773448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.774164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.775875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.786496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1023/2102] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:53.790450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.800635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65202610-b135-4f93-ad55-ce1d5c24d2d6 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.805333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.805974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.806262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.806542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.807306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.808949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.820444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1024/2103] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:53.824179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:53.834330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa031-f46f-4e5a-a076-cb8dfc83b6c2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:53.838970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1113-6181-41ce-83f2-7b75ba0a8aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:53.839803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1113-6181-41ce-83f2-7b75ba0a8aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.840090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1113-6181-41ce-83f2-7b75ba0a8aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.840367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1113-6181-41ce-83f2-7b75ba0a8aa7 admin admin] PATH_INFO: `/v3/projects/354028e99f5b4649b7a4ba6e98612fd1/users/cfe4433569ef45858dacaa7cef990bc4/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:53.854539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1113-6181-41ce-83f2-7b75ba0a8aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354028e99f5b4649b7a4ba6e98612fd1, user_id=cfe4433569ef45858dacaa7cef990bc4, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:53.857192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1113-6181-41ce-83f2-7b75ba0a8aa7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:53.966914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1025/2104] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:53 2022] PUT /identity/v3/projects/354028e99f5b4649b7a4ba6e98612fd1/users/cfe4433569ef45858dacaa7cef990bc4/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:53.977330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:53.977639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:53.977919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:54.013834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eeaf761735844f595d0de0f903b1e7a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:54.017765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] MFA Rules not processed for user `cfe4433569ef45858dacaa7cef990bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:54.019074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:54.084659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1026/2105] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:54.095709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:54.097159 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:54.115199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eeaf761735844f595d0de0f903b1e7a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:54.115821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eeaf761735844f595d0de0f903b1e7a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:54.124490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eeaf761735844f595d0de0f903b1e7a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:54.136372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eeaf761735844f595d0de0f903b1e7a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:54.142551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1080/2106] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:53 2022] DELETE /identity/v3/users/0eeaf761735844f595d0de0f903b1e7a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:47:54.154953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902639-87dd-4d93-8e1e-75f2647b57ad None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:54.205905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:54.206571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:54.206890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:54.207170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:54.209073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:54.256662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:54.272090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:54.273542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45940e9-7ab5-40e8-9a24-bcb8bba25bc7 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:54.282749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1027/2107] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:47:54.671056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:54.673387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:54.754582 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e2ffe-988f-439a-84b9-8b88b1f21534 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:54.760564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:54.761450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:54.761737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:54.762018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] PATH_INFO: `/v3/projects/d793a225866a4948a691af7812a0cc38` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:54.764319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d793a225866a4948a691af7812a0cc38)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:54.766310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:54.909798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd793a225866a4948a691af7812a0cc38', 'request_id': 'req-1fd7749c-668d-4c9c-8ae2-904ca5885a88'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:54.916230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd793a225866a4948a691af7812a0cc38', 'request_id': 'req-1fd7749c-668d-4c9c-8ae2-904ca5885a88'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:55.020536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd793a225866a4948a691af7812a0cc38', 'request_id': 'req-1fd7749c-668d-4c9c-8ae2-904ca5885a88'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:55.036786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] The token cache is being invalidate because project d793a225866a4948a691af7812a0cc38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:55.040500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:55.040500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1fd7749c-668d-4c9c-8ae2-904ca5885a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:55.040500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1081/2108] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:54 2022] DELETE /identity/v3/projects/d793a225866a4948a691af7812a0cc38 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:55.044666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.045239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.045239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.073250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:55.075547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:55.185244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1028/2109] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:55.194614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.194991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.195294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.244599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:55.249084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:55.260418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1082/2110] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:55.270162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:55.280858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90ff6d-dd5e-4296-8185-9402a46e3df1 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:55.287333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:55.288106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.288618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.288962 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.290599 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:55.291021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:55.293110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:55.307020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1029/2111] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:55.311960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:55.321771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5a7f-41f0-4113-9f65-a51fe3f4d90e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:55.327776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:55.328518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.328869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.329211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.329985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:55.332028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:55.506916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1083/2112] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:55 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:55.511233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:55.523995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a427f-f338-429c-bee4-ad3db23d43a0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:55.582232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:55.582953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.583244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.583527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.584228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:55.586208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:55.723176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1030/2113] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:55 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:55.724769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:55.735132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb796b-d00d-42bd-9fd7-d6ab887229ea admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:55.739712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:55.740382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.740663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.740935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.741675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:55.743566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:55.761540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1084/2114] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:55.765938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:55.790566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f15dd9-32c9-42b0-8564-26926a345f4a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:55.811376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2f6b5-76b7-4266-826b-95b54ade2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:55.812606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2f6b5-76b7-4266-826b-95b54ade2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.813044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2f6b5-76b7-4266-826b-95b54ade2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.814676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2f6b5-76b7-4266-826b-95b54ade2ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.816426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2f6b5-76b7-4266-826b-95b54ade2ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:55.819154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2f6b5-76b7-4266-826b-95b54ade2ac9 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:55.843610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1031/2115] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:55.844445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:55.861548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f22e2-c1b1-4769-88a3-b0be03e272d0 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:55.882617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:55.883642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:55.883997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:55.884364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] PATH_INFO: `/v3/projects/7173733b72924ea693ccd35bdc825ce0/users/8dbcebda6d6b4f4fbaf7300cf0ab7161/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:55.938933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7173733b72924ea693ccd35bdc825ce0, user_id=8dbcebda6d6b4f4fbaf7300cf0ab7161, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:55.947989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.032126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1085/2116] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:55 2022] PUT /identity/v3/projects/7173733b72924ea693ccd35bdc825ce0/users/8dbcebda6d6b4f4fbaf7300cf0ab7161/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:56.042570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.042900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.043185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.078302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] MFA Rules not processed for user `8dbcebda6d6b4f4fbaf7300cf0ab7161`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:56.079256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:56.177863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1032/2117] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:56.182656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.253558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b7d7d-cbe8-44c6-8aa6-02166950edef admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:56.258280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:56.258975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.259257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.259529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.260220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:56.262264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.369040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1086/2118] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:56 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:56.373287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.384853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48222ff-ef78-4c91-a387-983aa4783ad5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:56.443390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:56.444071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.444387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.444660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.445444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:56.447425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.585858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1033/2119] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:56 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:56.597153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.607841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99217d9-bc44-43f2-929d-60f0c2e71c8e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:56.613493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:56.614247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.614603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.615054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.615877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:56.617621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.629416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1087/2120] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:56.633807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.644580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873650-4717-4fcc-8b1b-00b8a331fb90 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:56.649357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:56.650250 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.650563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.650892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] PATH_INFO: `/v3/projects/9e782a27fa5d44ae8dc465cac0f9da87/users/29c04af6c6cc48969794db10a8f40196/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.666546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e782a27fa5d44ae8dc465cac0f9da87, user_id=29c04af6c6cc48969794db10a8f40196, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:56.669288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.744242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1034/2121] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:56 2022] PUT /identity/v3/projects/9e782a27fa5d44ae8dc465cac0f9da87/users/29c04af6c6cc48969794db10a8f40196/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:56.748423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.759010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ef2a-084d-4d6d-8b86-9d98b043f96f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:56.818109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:56.819384 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db035-d5a1-4cc7-a89d-f777976e20a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:56.820071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db035-d5a1-4cc7-a89d-f777976e20a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.820361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db035-d5a1-4cc7-a89d-f777976e20a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.820740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db035-d5a1-4cc7-a89d-f777976e20a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.821633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db035-d5a1-4cc7-a89d-f777976e20a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:56.823314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db035-d5a1-4cc7-a89d-f777976e20a2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.837238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1088/2122] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:56.838625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.850211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ceb8-621a-4a54-8fe9-c3f2e444f717 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:56.859462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:56.859462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.859462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.859462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] PATH_INFO: `/v3/projects/9e782a27fa5d44ae8dc465cac0f9da87/users/29c04af6c6cc48969794db10a8f40196/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.860024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e782a27fa5d44ae8dc465cac0f9da87, user_id=29c04af6c6cc48969794db10a8f40196, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:56.862650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:56.873369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1035/2123] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:56 2022] PUT /identity/v3/projects/9e782a27fa5d44ae8dc465cac0f9da87/users/29c04af6c6cc48969794db10a8f40196/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:56.884750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:56.885044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:56.885325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:56.913778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] MFA Rules not processed for user `29c04af6c6cc48969794db10a8f40196`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:56.915127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:56.986134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1089/2124] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:56.997954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:56.999939 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:57.061289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2679d-644c-4c1a-8cd7-871f63c6a07d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:57.065068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b2f8-0ce7-407d-ad50-df4076952833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:57.065718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b2f8-0ce7-407d-ad50-df4076952833 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:57.066105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b2f8-0ce7-407d-ad50-df4076952833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:57.066390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b2f8-0ce7-407d-ad50-df4076952833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:57.123497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b2f8-0ce7-407d-ad50-df4076952833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:57.125042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b2f8-0ce7-407d-ad50-df4076952833 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:57.134943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1036/2125] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:57.395250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:57.541704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:57.547100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:57.606553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1321-9327-464a-896f-d3a72d69b302 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:57.611097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:57.611962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:57.612239 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:57.612506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] PATH_INFO: `/v3/users/cfe4433569ef45858dacaa7cef990bc4` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:57.613688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe4433569ef45858dacaa7cef990bc4)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:57.615643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:57.818526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:57.953485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe4433569ef45858dacaa7cef990bc4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:58.075390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe4433569ef45858dacaa7cef990bc4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:58.077210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe4433569ef45858dacaa7cef990bc4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:58.087866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe4433569ef45858dacaa7cef990bc4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:58.104772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe4433569ef45858dacaa7cef990bc4'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:58.118571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1090/2126] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:47:57 2022] DELETE /identity/v3/users/cfe4433569ef45858dacaa7cef990bc4 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:58.122993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:58.124113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:58.124704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:58.149148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:58.150399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:58.228089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1037/2127] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:58.238817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:58.240382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:58.306604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100fc4c-f35a-4272-8ffe-cb420a127736 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:58.312188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063e271-45be-4294-ac25-b8e0083b3ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:58.312963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e271-45be-4294-ac25-b8e0083b3ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:58.313318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e271-45be-4294-ac25-b8e0083b3ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:58.313698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e271-45be-4294-ac25-b8e0083b3ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:58.323824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063e271-45be-4294-ac25-b8e0083b3ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:58.325407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063e271-45be-4294-ac25-b8e0083b3ccf service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:58.335628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1091/2128] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:47:58.823709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:58.825432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:58.840894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d0b0c-80c1-4dab-a9bf-4065362a5e33 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:58.847604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:58.848531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:58.848813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:58.849167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] PATH_INFO: `/v3/projects/354028e99f5b4649b7a4ba6e98612fd1` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:58.850350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] RBAC: Authorizing `identity:delete_project(project_id=354028e99f5b4649b7a4ba6e98612fd1)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:58.852326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:58.988117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354028e99f5b4649b7a4ba6e98612fd1', 'request_id': 'req-d1145409-8bbd-4a66-8ef1-de20c8ee105d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:58.994579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354028e99f5b4649b7a4ba6e98612fd1', 'request_id': 'req-d1145409-8bbd-4a66-8ef1-de20c8ee105d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:59.052562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354028e99f5b4649b7a4ba6e98612fd1', 'request_id': 'req-d1145409-8bbd-4a66-8ef1-de20c8ee105d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:59.065268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] The token cache is being invalidate because project 354028e99f5b4649b7a4ba6e98612fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:47:59.065734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:59.069555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d1145409-8bbd-4a66-8ef1-de20c8ee105d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:47:59.072286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1038/2129] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:47:58 2022] DELETE /identity/v3/projects/354028e99f5b4649b7a4ba6e98612fd1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:59.076381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.076892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.076892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.102332 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:59.103593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:59.169807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1092/2130] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:59.178607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.178879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.179164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.198150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:59.199430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:59.207828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1039/2131] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:47:59.211950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.222229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fc10-1083-4052-a95f-4f77fd3f7624 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.227319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.227976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.228261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.228534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.229263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:47:59.229567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.231191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.243629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1093/2132] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:47:59.248063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.257202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2be943-53e3-460b-8dee-858bfaa26c49 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.261874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e5c1-fb40-45f3-8826-4726a69ccf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.262522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e5c1-fb40-45f3-8826-4726a69ccf71 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.262844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e5c1-fb40-45f3-8826-4726a69ccf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.263122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e5c1-fb40-45f3-8826-4726a69ccf71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.263824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2e5c1-fb40-45f3-8826-4726a69ccf71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.266580 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2e5c1-fb40-45f3-8826-4726a69ccf71 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.433006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1040/2133] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:47:59 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:59.435767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.446663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28fa8b-2447-4d15-9917-76196c90e86b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.511209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.511964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.512252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.512527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.513216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.516386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.602261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.602548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.602871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.613653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1094/2134] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:47:59 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:47:59.618322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.646478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16cb7-ee1a-4de6-a589-6a7287084991 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.648078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:59.652508 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:59.652625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.652625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.652817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.653317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.654119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.656303 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.672477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1095/2135] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:47:59.676654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.689061 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435624ee-9bf8-423f-90b6-478f277be880 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.693610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.694280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.694587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.694901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.695639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.697314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.710739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1096/2136] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:47:59.715086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.721815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1041/2137] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:59.726405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916a4a-1e85-4505-8ee6-b18e18a71b2b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.732646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736c81-4505-4395-bd20-32b330fb0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.734415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736c81-4505-4395-bd20-32b330fb0df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.734741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736c81-4505-4395-bd20-32b330fb0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.735135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736c81-4505-4395-bd20-32b330fb0df1 admin admin] PATH_INFO: `/v3/projects/0a5aec34986e4c23a39e3b7f87d6e6c5/users/da7b029c64b54365a20753ef3b91e6ee/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.762557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736c81-4505-4395-bd20-32b330fb0df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5aec34986e4c23a39e3b7f87d6e6c5, user_id=da7b029c64b54365a20753ef3b91e6ee, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.768209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736c81-4505-4395-bd20-32b330fb0df1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.770449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.778257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:59.854470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc4a1d-a464-4eec-b55f-535245aa075b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:47:59.856394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1097/2138] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:47:59 2022] PUT /identity/v3/projects/0a5aec34986e4c23a39e3b7f87d6e6c5/users/da7b029c64b54365a20753ef3b91e6ee/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:47:59.868914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.869208 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.869494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.898421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] MFA Rules not processed for user `da7b029c64b54365a20753ef3b91e6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:47:59.899716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:59.921558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:47:59.922223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:47:59.922510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:47:59.922824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:47:59.970144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1098/2139] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:47:59.979421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:47:59.980814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:47:59.982406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:47:59.984976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:47:59.993561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1042/2140] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:47:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:48:00.041982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c922456-e7f5-4198-bf43-ed601148a050 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:00.046899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f101-46b6-4521-bfbc-8acb9ec7d2ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:00.047571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f101-46b6-4521-bfbc-8acb9ec7d2ac service glance] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:00.047892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f101-46b6-4521-bfbc-8acb9ec7d2ac service glance] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:00.048142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f101-46b6-4521-bfbc-8acb9ec7d2ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:00.058059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f101-46b6-4521-bfbc-8acb9ec7d2ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:00.059692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f101-46b6-4521-bfbc-8acb9ec7d2ac service glance] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:00.070007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1099/2141] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:47:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:00.146436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:00.148166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:00.156567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:00.236143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d20f21-551e-4969-936f-53fde0ed9e7a service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:00.240267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:00.244357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:00.244357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:00.244357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:00.244357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:00.309732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:00.311790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:00.322077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1043/2142] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:00.584269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:01.154933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac308f-7034-4dba-9104-7cbd3002495f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:01.155230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac308f-7034-4dba-9104-7cbd3002495f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:01.155499 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac308f-7034-4dba-9104-7cbd3002495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:01.187371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-aeac308f-7034-4dba-9104-7cbd3002495f None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:01.189602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aeac308f-7034-4dba-9104-7cbd3002495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:01.206020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1100/2143] 10.222.0.49 () {58 vars in 967 bytes} [Thu Jul 21 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:01.220215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:01.234352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487230f-99db-480d-a1f4-3922b6e64517 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:01.241576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:01.242298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:01.242675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:01.243499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:01.252707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:01.263576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:01.264406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1044/2144] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:48:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:48:01.988079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6241f-09f8-40a1-a900-0fa319be03b6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:01.988406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6241f-09f8-40a1-a900-0fa319be03b6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:01.988689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6241f-09f8-40a1-a900-0fa319be03b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:02.021482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e6f6241f-09f8-40a1-a900-0fa319be03b6 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:02.024958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e6f6241f-09f8-40a1-a900-0fa319be03b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:02.031148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1101/2145] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:02.045742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:02.065554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9731a06-79c9-465a-b96a-23651e5188c1 service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:02.073277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:02.075075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:02.075748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:02.076097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:02.087663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:02.090379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:02.101540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1045/2146] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:48:02.178915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:02.361311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:02.806876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:02.807335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:02.807435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:02.827494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:02.830617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:02.837099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1102/2147] 10.222.0.49 () {58 vars in 967 bytes} [Thu Jul 21 10:48:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:02.852578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:02.863817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad423-4b6d-40f7-8083-3e3bb589eb21 service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:02.871727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573efd-6780-4a60-9570-cdf8b8bbdca5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:02.872401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573efd-6780-4a60-9570-cdf8b8bbdca5 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:02.872711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573efd-6780-4a60-9570-cdf8b8bbdca5 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:02.872991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573efd-6780-4a60-9570-cdf8b8bbdca5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:02.882208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573efd-6780-4a60-9570-cdf8b8bbdca5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:02.883855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573efd-6780-4a60-9570-cdf8b8bbdca5 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:02.892513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1046/2148] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:48:03.102476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:03.316642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:04.361688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:04.527076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:04.710500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:05.129634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:05.131177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:05.173788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:05.205670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d830d-447f-4c27-af7d-5356d8350728 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:05.210229 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:05.211292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:05.211583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:05.211861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] PATH_INFO: `/v3/users/8dbcebda6d6b4f4fbaf7300cf0ab7161` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:05.213336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbcebda6d6b4f4fbaf7300cf0ab7161)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:05.215412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:05.512335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbcebda6d6b4f4fbaf7300cf0ab7161'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:05.584322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbcebda6d6b4f4fbaf7300cf0ab7161'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:05.585426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbcebda6d6b4f4fbaf7300cf0ab7161'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:05.600809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbcebda6d6b4f4fbaf7300cf0ab7161'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:05.627374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbcebda6d6b4f4fbaf7300cf0ab7161'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:05.633616 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1103/2149] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:05 2022] DELETE /identity/v3/users/8dbcebda6d6b4f4fbaf7300cf0ab7161 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:05.638430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:05.639269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:05.639768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:05.657721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:05.658968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:05.723106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1047/2150] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:05.733776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:05.736134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:05.796623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda8a39-4589-4f75-9094-aefca367b091 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:05.800308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:05.800963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:05.801243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:05.801515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:05.811084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:05.812699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:05.816845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:05.822660 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1104/2151] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:06.047699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:06.253461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:06.255043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:06.269046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec51ed-2b45-4473-8825-470ac7e1b482 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:06.274182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:06.275093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:06.275377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:06.275652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] PATH_INFO: `/v3/users/f31abd32ccae4dd39a3c220b969aff06` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:06.277456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31abd32ccae4dd39a3c220b969aff06)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:06.279572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:06.380600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:06.382058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:06.395954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cfcd0-e923-45d3-9d58-a35632a07903 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:06.400571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:06.401436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:06.401716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:06.401992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] PATH_INFO: `/v3/projects/7173733b72924ea693ccd35bdc825ce0` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:06.403209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7173733b72924ea693ccd35bdc825ce0)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:06.409280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:06.559778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31abd32ccae4dd39a3c220b969aff06'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.564428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7173733b72924ea693ccd35bdc825ce0', 'request_id': 'req-bcbf37f3-3f77-49e3-99ea-eabc13601a49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.570758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7173733b72924ea693ccd35bdc825ce0', 'request_id': 'req-bcbf37f3-3f77-49e3-99ea-eabc13601a49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.714151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31abd32ccae4dd39a3c220b969aff06'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.728699 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31abd32ccae4dd39a3c220b969aff06'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.729486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31abd32ccae4dd39a3c220b969aff06'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.737632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-dec69455-feaa-4702-bcec-3f3abac169bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31abd32ccae4dd39a3c220b969aff06'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.744758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1048/2152] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:06 2022] DELETE /identity/v3/users/f31abd32ccae4dd39a3c220b969aff06 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:06.749417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:06.749908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:06.750729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:06.772318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:06.773932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:06.830370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7173733b72924ea693ccd35bdc825ce0', 'request_id': 'req-bcbf37f3-3f77-49e3-99ea-eabc13601a49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.845003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1049/2153] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:06.845308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] The token cache is being invalidate because project 7173733b72924ea693ccd35bdc825ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:06.845308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.845308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:06.845632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1105/2154] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:06 2022] DELETE /identity/v3/projects/7173733b72924ea693ccd35bdc825ce0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:06.849892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:06.850012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:06.851381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:06.851492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:06.863307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c9e13-3b92-4dc1-9925-1301f602d782 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:06.867918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:06.869042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:06.869325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:06.869604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] PATH_INFO: `/v3/users/29c04af6c6cc48969794db10a8f40196` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:06.870848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c04af6c6cc48969794db10a8f40196)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:06.872792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:06.911777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf37f3-3f77-49e3-99ea-eabc13601a49 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:06.929650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:06.969420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:06.970181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:06.970528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:06.971122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:06.973180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:06.995679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:06.997142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:07.007491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1106/2155] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:07.088907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c04af6c6cc48969794db10a8f40196'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.149768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c04af6c6cc48969794db10a8f40196'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.164601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c04af6c6cc48969794db10a8f40196'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.165412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c04af6c6cc48969794db10a8f40196'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.173234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c04af6c6cc48969794db10a8f40196'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.179755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1050/2156] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:06 2022] DELETE /identity/v3/users/29c04af6c6cc48969794db10a8f40196 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:07.267946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:07.269696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:07.286677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c190-1065-4b5e-9e1b-25e2cd972164 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:07.290049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:07.373042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:07.378938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:07.379290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:07.379576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] PATH_INFO: `/v3/projects/7d9e72b3a2d44dea92e5479451d54f19` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:07.381142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9e72b3a2d44dea92e5479451d54f19)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:07.384467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:07.527845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9e72b3a2d44dea92e5479451d54f19', 'request_id': 'req-fc83de87-5ebd-4171-ae43-8f074f1b16c7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.534415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9e72b3a2d44dea92e5479451d54f19', 'request_id': 'req-fc83de87-5ebd-4171-ae43-8f074f1b16c7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.612696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9e72b3a2d44dea92e5479451d54f19', 'request_id': 'req-fc83de87-5ebd-4171-ae43-8f074f1b16c7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.626134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] The token cache is being invalidate because project 7d9e72b3a2d44dea92e5479451d54f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:07.626449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.627172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:07.630390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1107/2157] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:07 2022] DELETE /identity/v3/projects/7d9e72b3a2d44dea92e5479451d54f19 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:07.771235 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:07.772731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:07.794659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58c5f-6181-40f0-bb49-4d5d7892c697 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:07.863794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:07.864769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:07.865067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:07.865327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] PATH_INFO: `/v3/users/8cf59045d9eb4a3d8cf0e0ea57fc7268` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:07.867629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf59045d9eb4a3d8cf0e0ea57fc7268)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:07.870123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:07.917232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:07.918817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:07.935445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83de87-5ebd-4171-ae43-8f074f1b16c7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:07.940836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:07.941754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:07.942066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:07.942981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] PATH_INFO: `/v3/projects/9e782a27fa5d44ae8dc465cac0f9da87` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:07.944473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e782a27fa5d44ae8dc465cac0f9da87)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:07.946618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.114432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf59045d9eb4a3d8cf0e0ea57fc7268'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.114633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e782a27fa5d44ae8dc465cac0f9da87', 'request_id': 'req-0055dada-d273-4119-9d92-dd278e91da3f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.121104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e782a27fa5d44ae8dc465cac0f9da87', 'request_id': 'req-0055dada-d273-4119-9d92-dd278e91da3f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.190697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf59045d9eb4a3d8cf0e0ea57fc7268'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.203804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf59045d9eb4a3d8cf0e0ea57fc7268'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.204469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf59045d9eb4a3d8cf0e0ea57fc7268'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.211190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf59045d9eb4a3d8cf0e0ea57fc7268'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.214045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:08.218952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1051/2158] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:07 2022] DELETE /identity/v3/users/8cf59045d9eb4a3d8cf0e0ea57fc7268 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:08.222427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.222427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.241575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e782a27fa5d44ae8dc465cac0f9da87', 'request_id': 'req-0055dada-d273-4119-9d92-dd278e91da3f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.255146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] The token cache is being invalidate because project 9e782a27fa5d44ae8dc465cac0f9da87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:08.255432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.256854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-0055dada-d273-4119-9d92-dd278e91da3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.258636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1108/2159] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:07 2022] DELETE /identity/v3/projects/9e782a27fa5d44ae8dc465cac0f9da87 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:08.263162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57bdf6-9f82-49c5-b364-df59daf4b6da None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.263469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57bdf6-9f82-49c5-b364-df59daf4b6da None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.263731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57bdf6-9f82-49c5-b364-df59daf4b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.287342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7b57bdf6-9f82-49c5-b364-df59daf4b6da None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:08.288076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7b57bdf6-9f82-49c5-b364-df59daf4b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.297246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1109/2160] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:08.300899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473caee2-35ac-4194-bdd1-7fa6a3e24267 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.305104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.305393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.305677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.306740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.307873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.308187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.308524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] PATH_INFO: `/v3/users/b5bb625bf1264a6bb127537b6b811fb8` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.309883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bb625bf1264a6bb127537b6b811fb8)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.312647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.326643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:08.328444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.337054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1110/2161] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:08.341053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.350833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c23fd-9571-4854-95aa-f465ab2df405 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.355708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.356403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.356650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.356923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.357653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:08.357959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.360451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.377462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1111/2162] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:08.378369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.388824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357ebc-cb18-4173-a629-d4526af6ff97 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.394213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.394937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.395223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.395500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.396188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.398118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.536890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1112/2163] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:08 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:08.537728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.541412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.550600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bb625bf1264a6bb127537b6b811fb8'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.611705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c1b4-9539-4bdc-9b3b-57c1bfcb9b51 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.616428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.617292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.617579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.617857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] PATH_INFO: `/v3/projects/61a0378ab916492d9e48048881b6df28` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.619353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a0378ab916492d9e48048881b6df28)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.621278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.647045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bb625bf1264a6bb127537b6b811fb8'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.660397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bb625bf1264a6bb127537b6b811fb8'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.661098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bb625bf1264a6bb127537b6b811fb8'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.662404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:08.668361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bb625bf1264a6bb127537b6b811fb8'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.675515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1052/2164] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:08 2022] DELETE /identity/v3/users/b5bb625bf1264a6bb127537b6b811fb8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:08.677245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.679633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.735750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a0378ab916492d9e48048881b6df28', 'request_id': 'req-b99f021a-1f9b-43df-b672-c6ac400525dd'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.745835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c603-376d-4845-a08f-79f95b86146c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.746081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a0378ab916492d9e48048881b6df28', 'request_id': 'req-b99f021a-1f9b-43df-b672-c6ac400525dd'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.806194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.807045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.807367 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.807642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.808869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.810879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.864433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a0378ab916492d9e48048881b6df28', 'request_id': 'req-b99f021a-1f9b-43df-b672-c6ac400525dd'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.876497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] The token cache is being invalidate because project 61a0378ab916492d9e48048881b6df28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:08.876794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.877436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b99f021a-1f9b-43df-b672-c6ac400525dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:08.879113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1113/2165] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:08 2022] DELETE /identity/v3/projects/61a0378ab916492d9e48048881b6df28 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:08.880331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.880619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.880895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.900793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1053/2166] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:08 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:08.900979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:08.901102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.901194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.901306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.909307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1114/2167] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:08.910149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.913324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:08.918544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aa480-b669-4c48-80a0-95f8cee65380 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.923808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.924743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.925058 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.925349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] PATH_INFO: `/v3/users/eadd78bd46814ec0a6b3465e3ec4e6ac` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.925983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ad82b-144e-4cc0-a22a-58f484555342 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:08.926629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadd78bd46814ec0a6b3465e3ec4e6ac)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.928674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.931495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:08.931821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:08.932102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:08.932390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:08.933127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:08.934732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:08.948634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1115/2168] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:08.948634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:08.952084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:09.011739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429bb40-a6bc-40fe-a315-1001e3e4c224 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.015955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:09.016620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.016909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.017189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.026671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:09.028145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:09.038119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1116/2169] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:09.039570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:09.051421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a936-f61a-4055-a02d-bc0ea56ea6db service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.056359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:09.057045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.057412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.057696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.058441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:09.060103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:09.074664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1117/2170] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:09.075912 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:09.086025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20954e6-10dc-4a32-a0e8-83d47024bacc admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.090870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf319-bf86-478a-8206-f8ae7a7e9bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:09.091782 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf319-bf86-478a-8206-f8ae7a7e9bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.092068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf319-bf86-478a-8206-f8ae7a7e9bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.092345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf319-bf86-478a-8206-f8ae7a7e9bae admin admin] PATH_INFO: `/v3/projects/5c2e1d2c402a4eed87e67844caba68c6/users/9f552e497bec4dbe87734895e87b2306/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.112267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf319-bf86-478a-8206-f8ae7a7e9bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2e1d2c402a4eed87e67844caba68c6, user_id=9f552e497bec4dbe87734895e87b2306, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:09.114955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf319-bf86-478a-8206-f8ae7a7e9bae admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:09.142610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadd78bd46814ec0a6b3465e3ec4e6ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.161775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:09.225185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1118/2171] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:09 2022] PUT /identity/v3/projects/5c2e1d2c402a4eed87e67844caba68c6/users/9f552e497bec4dbe87734895e87b2306/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:09.236367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.236656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.236933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.253374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadd78bd46814ec0a6b3465e3ec4e6ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.256702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:09.266011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] MFA Rules not processed for user `9f552e497bec4dbe87734895e87b2306`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:09.267604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:09.272966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadd78bd46814ec0a6b3465e3ec4e6ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.273938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadd78bd46814ec0a6b3465e3ec4e6ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.282215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadd78bd46814ec0a6b3465e3ec4e6ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.288687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1054/2172] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:08 2022] DELETE /identity/v3/users/eadd78bd46814ec0a6b3465e3ec4e6ac => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:09.348867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1119/2173] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:09.353746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:09.355476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:09.435355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58caf2-c78e-4d0e-99a0-5c8c1a3698bb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.443543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:09.445231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.445603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.445961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.448285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:09.448850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:09.563913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:09.566441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:09.572216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1055/2174] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:09 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:09.573374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:09.575111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:09.651546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87ebf-c054-4171-a94b-dc44b6d075f6 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.657832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:09.658983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.659264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.659545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] PATH_INFO: `/v3/projects/17c4b8223f2c4b19baead8f9eb55c234` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.660816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c4b8223f2c4b19baead8f9eb55c234)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:09.663567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:09.680798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7039-08f2-443e-a7ae-35c1d51723e3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.685756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:09.687425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.687827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.688226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] PATH_INFO: `/v3/projects/29e97c0b11494315ad5007eb446a1fbe` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.689609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e97c0b11494315ad5007eb446a1fbe)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:09.692322 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:09.778440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c4b8223f2c4b19baead8f9eb55c234', 'request_id': 'req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.784877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c4b8223f2c4b19baead8f9eb55c234', 'request_id': 'req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.814811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e97c0b11494315ad5007eb446a1fbe', 'request_id': 'req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.821042 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e97c0b11494315ad5007eb446a1fbe', 'request_id': 'req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.856649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c4b8223f2c4b19baead8f9eb55c234', 'request_id': 'req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.868877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] The token cache is being invalidate because project 17c4b8223f2c4b19baead8f9eb55c234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:09.869168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.869827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.871426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1056/2175] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:09 2022] DELETE /identity/v3/projects/17c4b8223f2c4b19baead8f9eb55c234 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:09.872157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:09.873449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:09.930659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e97c0b11494315ad5007eb446a1fbe', 'request_id': 'req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.939182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30223d51-9bb1-4a02-9ff7-e6bc7e37c7ad admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:09.943632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] The token cache is being invalidate because project 29e97c0b11494315ad5007eb446a1fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:09.944080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.944852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2827c443-06ab-4e0a-8d04-6a7411bc9dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:09.946770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1120/2176] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:09 2022] DELETE /identity/v3/projects/29e97c0b11494315ad5007eb446a1fbe => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:09.948548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d48-475b-45ec-aa90-6265d7f0a99b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:09.948921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d48-475b-45ec-aa90-6265d7f0a99b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:09.949277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d48-475b-45ec-aa90-6265d7f0a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:09.968334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-13626d48-475b-45ec-aa90-6265d7f0a99b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:09.969748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-13626d48-475b-45ec-aa90-6265d7f0a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:10.006730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.007585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.007882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.008186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.008884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.011390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.032857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1121/2177] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:10.034147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731118-b1b4-4f53-8f3b-723c788542ce None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.034438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731118-b1b4-4f53-8f3b-723c788542ce None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.034859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731118-b1b4-4f53-8f3b-723c788542ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.054924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e6731118-b1b4-4f53-8f3b-723c788542ce None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:10.056140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e6731118-b1b4-4f53-8f3b-723c788542ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:10.067151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1122/2178] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:10.068456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb621148-18b7-4da1-a980-154dd8054461 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.068727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb621148-18b7-4da1-a980-154dd8054461 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.069003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb621148-18b7-4da1-a980-154dd8054461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.087898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bb621148-18b7-4da1-a980-154dd8054461 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:10.089107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bb621148-18b7-4da1-a980-154dd8054461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:10.098197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1123/2179] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:10.099567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.099854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.100126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.118823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:10.120003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:10.128713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1124/2180] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:10.132005 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.133187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1057/2181] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:09 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:10.136164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.139511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980cd14-6a64-4155-ba0f-b6cccd87b28f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.144970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042340a0-6907-4e09-ac1c-bdf29aa23ba4 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.145134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.145688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.145999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.146273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.147079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:10.150302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.150302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.150630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.150630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.150630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.150909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.151603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:10.151915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.153488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.167551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1125/2182] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:10.167551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.167551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:10.168018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1058/2183] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:10.171229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.181553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce56def-0f99-4329-b428-b33a2de89b18 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.182122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060f1d7-4651-4838-9180-358c3d31029a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.187039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.187590 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.187949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.190833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.190975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.190975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.191154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.191154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.191353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.191448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.191587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.191713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.203260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1126/2184] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:10.204171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.216778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62ffc-d758-4be1-bf44-978502098fb2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.222137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.222840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.223154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.223473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.225311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.226319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.332865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1059/2185] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/projects => generated 399 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:10.333670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.357498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1127/2186] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:10.358236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.395394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fed6d-22be-4b36-b3cf-fad8b622c572 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.424287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8cfcc-53d3-42c4-8e37-8b546a6dd755 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.429071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.429724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.430006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.430289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.431011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.432992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.442607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:10.454811 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.455741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.456025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.456302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] PATH_INFO: `/v3/projects/17716dbfcccf4f0299922b0eb7f8559b/users/1b77cc5cf37a490da6eff104da21f599/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.471684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17716dbfcccf4f0299922b0eb7f8559b, user_id=1b77cc5cf37a490da6eff104da21f599, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.474566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.487501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:10.578969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1128/2187] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:10.579879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.589708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6b85-8d24-4226-bb62-9cfcede4289e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.594295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.594980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.595267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.595594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.596329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.598250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.633931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1060/2188] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:10 2022] PUT /identity/v3/projects/17716dbfcccf4f0299922b0eb7f8559b/users/1b77cc5cf37a490da6eff104da21f599/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:10.634800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.699741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a68f-9217-41b1-8c90-881c80c71e7f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.705021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.711110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.711110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.711287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1129/2189] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:10.711366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.711366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.711511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.711584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.717256 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f573-f0c9-48e1-8cd1-3b1d6fffede9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.718981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1061/2190] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:10.719786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.722734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.723524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.723781 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.724057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.724797 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.726418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.730398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f44e-47ad-4c45-a760-9a4b993e7d7c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.735817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.736483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.736846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.737129 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.741304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.741431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1130/2191] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:10.741431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.741676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.751219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1062/2192] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:10.751349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b73a0-17f2-452d-af51-11923824a5ed admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.752133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.756165 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.756817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.757100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.757402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.758129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.759843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.761997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf423e-6ba1-4bb0-b50e-8c304039e681 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.768084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.768987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.769278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.769543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] PATH_INFO: `/v3/projects/17716dbfcccf4f0299922b0eb7f8559b/users/1b77cc5cf37a490da6eff104da21f599/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.773227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1131/2193] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:10.773227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.775257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17716dbfcccf4f0299922b0eb7f8559b, user_id=1b77cc5cf37a490da6eff104da21f599, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.778066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.784407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb0870-a807-42ca-863b-c3e91cf324b3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.793501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1063/2194] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:10 2022] PUT /identity/v3/projects/17716dbfcccf4f0299922b0eb7f8559b/users/1b77cc5cf37a490da6eff104da21f599/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:10.794448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:10.808269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:10.853099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907d8a0-4e8e-4e83-9f76-54768ffcb31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.853879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907d8a0-4e8e-4e83-9f76-54768ffcb31f admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.854412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907d8a0-4e8e-4e83-9f76-54768ffcb31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.855318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907d8a0-4e8e-4e83-9f76-54768ffcb31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.856216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907d8a0-4e8e-4e83-9f76-54768ffcb31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.857992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907d8a0-4e8e-4e83-9f76-54768ffcb31f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.870192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1132/2195] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:10.875209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.875578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.875927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.882587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f02f58-d9f7-4b73-9750-cc972c2c5966 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:10.888273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58a38-4588-41b2-8e18-3bac5a59a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:10.889232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58a38-4588-41b2-8e18-3bac5a59a495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:10.889523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58a38-4588-41b2-8e18-3bac5a59a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:10.889803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58a38-4588-41b2-8e18-3bac5a59a495 admin admin] PATH_INFO: `/v3/projects/b9811abe0486482b93ea47b99bc5ba9e/users/329b1e66d97d4cc2b0078454d21fac5e/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:10.909407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58a38-4588-41b2-8e18-3bac5a59a495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9811abe0486482b93ea47b99bc5ba9e, user_id=329b1e66d97d4cc2b0078454d21fac5e, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:10.912345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58a38-4588-41b2-8e18-3bac5a59a495 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:10.917329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] MFA Rules not processed for user `1b77cc5cf37a490da6eff104da21f599`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:10.918563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:10.991019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1133/2196] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:10.993093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1064/2197] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:10 2022] PUT /identity/v3/projects/b9811abe0486482b93ea47b99bc5ba9e/users/329b1e66d97d4cc2b0078454d21fac5e/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:11.001073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.008188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54b799-552a-4589-8baa-471aa8b02995 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.009974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.010269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.010628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.041790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] MFA Rules not processed for user `329b1e66d97d4cc2b0078454d21fac5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:11.043178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:11.069865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.071010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.071306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.071581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] PATH_INFO: `/v3/projects/1df5e6200e84462b8e39b7cfcacc1c3e/users/fd2b74ad99d6462db6f51d146bbcf65c/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.092159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df5e6200e84462b8e39b7cfcacc1c3e, user_id=fd2b74ad99d6462db6f51d146bbcf65c, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.095381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.104829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:11.113868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1065/2198] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:11.114716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.115975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:11.162583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1134/2199] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:10 2022] PUT /identity/v3/projects/1df5e6200e84462b8e39b7cfcacc1c3e/users/fd2b74ad99d6462db6f51d146bbcf65c/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:11.163672 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.165394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:11.172037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:11.181500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e36d8b-8754-4b5c-b27b-721e27676b14 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.230515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d729df-b084-4ef9-9401-8f8532696c8a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.232377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.233017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.233302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.233579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.234312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722bf04-299d-4506-a781-d7131f09cb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.234995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722bf04-299d-4506-a781-d7131f09cb50 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.235289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722bf04-299d-4506-a781-d7131f09cb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.235580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722bf04-299d-4506-a781-d7131f09cb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.295777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722bf04-299d-4506-a781-d7131f09cb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.296127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.297262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722bf04-299d-4506-a781-d7131f09cb50 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.297664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.308004 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1135/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:11.309437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.309744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.310480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.310768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1066/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:11.341226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] MFA Rules not processed for user `fd2b74ad99d6462db6f51d146bbcf65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:11.346621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:11.421924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1136/2202] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:11.426160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.490483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.493228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:11.497144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321f4b0-d649-4d1b-835f-5cbdb00416ff service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.501735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b03b5-3275-4bbc-bf71-77b1248187b7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.502207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.504234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.504234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.504234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.504620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.508103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.509006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.509581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.509866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.510828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.512604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:11.565923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:11.582771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.584455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.596827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1137/2203] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:11.603607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1067/2204] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:11 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:11.607820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.619284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420b14-c035-419a-ba52-e2d21483e2fe service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.680898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.681571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.681855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.682152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.682867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.684849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.810310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1138/2205] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:11 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:11.813743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.824180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769aa7-132d-4536-b07f-4c4d40849820 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.829541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.830288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.830502 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.830824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.831565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.837063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.848416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1068/2206] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:48:11.853142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:11.863798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9769-f759-43b8-8a71-8e20eba21a8a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:11.868961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:11.870189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:11.870189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:11.870541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] PATH_INFO: `/v3/projects/45688c16890245bca8deaa82c08cced6/users/83443948cd97411e9680d4d8580d1aa6/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:11.887413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45688c16890245bca8deaa82c08cced6, user_id=83443948cd97411e9680d4d8580d1aa6, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:11.890909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:11.898492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:12.021434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:12.026017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1139/2207] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:11 2022] PUT /identity/v3/projects/45688c16890245bca8deaa82c08cced6/users/83443948cd97411e9680d4d8580d1aa6/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:12.028701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:12.041014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a8195-b8d8-494e-816a-18785917d870 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:12.118467 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c5d6a-cfb9-455a-a79f-e501dfe70bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:12.119453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5d6a-cfb9-455a-a79f-e501dfe70bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.119741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5d6a-cfb9-455a-a79f-e501dfe70bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.120133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5d6a-cfb9-455a-a79f-e501dfe70bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.120845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c5d6a-cfb9-455a-a79f-e501dfe70bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:12.122481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c5d6a-cfb9-455a-a79f-e501dfe70bbe admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:12.135188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1069/2208] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:48:12.139541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:12.150409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dd62e-931a-453b-a80b-8e0cc12df128 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:12.155234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:12.156351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.156647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.156948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] PATH_INFO: `/v3/projects/45688c16890245bca8deaa82c08cced6/users/83443948cd97411e9680d4d8580d1aa6/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.159282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45688c16890245bca8deaa82c08cced6, user_id=83443948cd97411e9680d4d8580d1aa6, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:12.161805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:12.174018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1140/2209] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:12 2022] PUT /identity/v3/projects/45688c16890245bca8deaa82c08cced6/users/83443948cd97411e9680d4d8580d1aa6/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:12.184320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.184616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.184931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.212332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] MFA Rules not processed for user `83443948cd97411e9680d4d8580d1aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:12.213671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:12.234975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:12.286124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1070/2210] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:12.297643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:12.307821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed462a-fa4f-484f-bca3-0a62c821677f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:12.313433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:12.314310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.314593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.314906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] PATH_INFO: `/v3/users/9f552e497bec4dbe87734895e87b2306` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.316285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f552e497bec4dbe87734895e87b2306)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:12.318465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:12.360592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de7db-6ef8-49d5-bf92-b65b6fa9b4fd None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:12.365413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea0734-daa2-4d66-bb6b-187598bd20a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:12.366214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0734-daa2-4d66-bb6b-187598bd20a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.366513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0734-daa2-4d66-bb6b-187598bd20a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.366823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0734-daa2-4d66-bb6b-187598bd20a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.430161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0734-daa2-4d66-bb6b-187598bd20a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:12.431667 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0734-daa2-4d66-bb6b-187598bd20a4 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:12.441267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1071/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:12.559072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f552e497bec4dbe87734895e87b2306'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:12.653040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f552e497bec4dbe87734895e87b2306'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:12.653792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f552e497bec4dbe87734895e87b2306'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:12.662331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f552e497bec4dbe87734895e87b2306'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:12.675032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f552e497bec4dbe87734895e87b2306'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:12.681261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1141/2212] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:12 2022] DELETE /identity/v3/users/9f552e497bec4dbe87734895e87b2306 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:12.686323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948e797-7f41-4541-a017-68823f876c62 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.686613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948e797-7f41-4541-a017-68823f876c62 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.687657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948e797-7f41-4541-a017-68823f876c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.706017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e948e797-7f41-4541-a017-68823f876c62 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:12.707274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e948e797-7f41-4541-a017-68823f876c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:12.768267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1072/2213] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:12.778255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:12.779969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:12.836611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbc484-5ade-4c09-b78a-7293a0a11dff admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:12.881728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:12.881728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:12.881728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:12.881728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:12.882274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:12.882274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:12.882274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1142/2214] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:13.303143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:13.431680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948e797-7f41-4541-a017-68823f876c62 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:13.432985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e948e797-7f41-4541-a017-68823f876c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:13.454851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948e797-7f41-4541-a017-68823f876c62 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:13.475564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:13.476713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:13.477002 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:13.477439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] PATH_INFO: `/v3/projects/5c2e1d2c402a4eed87e67844caba68c6` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:13.478982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2e1d2c402a4eed87e67844caba68c6)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:13.481091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:13.608481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:13.630480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2e1d2c402a4eed87e67844caba68c6', 'request_id': 'req-2a74a265-6930-4a6c-8d0b-ae66a6770272'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:13.636834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2e1d2c402a4eed87e67844caba68c6', 'request_id': 'req-2a74a265-6930-4a6c-8d0b-ae66a6770272'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:13.693986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2e1d2c402a4eed87e67844caba68c6', 'request_id': 'req-2a74a265-6930-4a6c-8d0b-ae66a6770272'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:13.706935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] The token cache is being invalidate because project 5c2e1d2c402a4eed87e67844caba68c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:13.707242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:13.707891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:13.709445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1073/2215] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:13 2022] DELETE /identity/v3/projects/5c2e1d2c402a4eed87e67844caba68c6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:13.713427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:13.723374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b6a02-1e48-448b-9eb1-dd17b70379d1 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:13.781100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:13.781988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:13.782277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:13.782556 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] PATH_INFO: `/v3/users/1b77cc5cf37a490da6eff104da21f599` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:13.783806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b77cc5cf37a490da6eff104da21f599)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:13.785865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:14.021003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b77cc5cf37a490da6eff104da21f599'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:14.104192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b77cc5cf37a490da6eff104da21f599'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:14.104806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b77cc5cf37a490da6eff104da21f599'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:14.114157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b77cc5cf37a490da6eff104da21f599'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:14.140144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ef758da3-e0a6-4151-b5bf-51809883e528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b77cc5cf37a490da6eff104da21f599'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:14.150389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1143/2216] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:13 2022] DELETE /identity/v3/users/1b77cc5cf37a490da6eff104da21f599 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:14.858146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:15.018248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:15.019750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:15.034931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74a265-6930-4a6c-8d0b-ae66a6770272 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:15.093017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:15.094242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:15.094514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:15.094822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] PATH_INFO: `/v3/projects/17716dbfcccf4f0299922b0eb7f8559b` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:15.096007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17716dbfcccf4f0299922b0eb7f8559b)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:15.097904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:15.251997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17716dbfcccf4f0299922b0eb7f8559b', 'request_id': 'req-fe49edd7-2196-48d8-8f4b-afa666e92fc1'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:15.258888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:15.259729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17716dbfcccf4f0299922b0eb7f8559b', 'request_id': 'req-fe49edd7-2196-48d8-8f4b-afa666e92fc1'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:15.456988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17716dbfcccf4f0299922b0eb7f8559b', 'request_id': 'req-fe49edd7-2196-48d8-8f4b-afa666e92fc1'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:15.468623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] The token cache is being invalidate because project 17716dbfcccf4f0299922b0eb7f8559b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:15.469078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:15.469742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fe49edd7-2196-48d8-8f4b-afa666e92fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:15.471384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1074/2217] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:15 2022] DELETE /identity/v3/projects/17716dbfcccf4f0299922b0eb7f8559b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:15.476242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:15.476570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:15.476830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:15.494923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:15.496124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:15.557154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1144/2218] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:15.565369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:15.565665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:15.565946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:15.586358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:15.587622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:15.599908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1075/2219] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:15.603268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:15.613717 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677cce6-f33f-4ae5-a861-00d4c298433b None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:15.620132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:15.620817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:15.621146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:15.621425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:15.622272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:15.622472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:15.624201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:15.645079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:15.646881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1145/2220] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:15.655287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07803dd-ab97-426d-8e3f-4ddbfdf91202 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:15.660768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:15.661574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:15.661971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:15.662320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:15.663220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:15.665123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:15.892266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1076/2221] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:15 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:48:15.893454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:15.904445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028e604-6c6d-4765-b0bc-56a3be0ecace admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:15.963155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:15.963936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:15.964294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:15.964669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:15.965450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:15.967426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.091586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1146/2222] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:15 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:16.096416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:16.106661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a178c2-f5d7-48d7-9b3f-e513066adaaa admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:16.111629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:16.112767 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.112877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.113164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.113899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:16.115567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.127307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1077/2223] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:16.131253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:16.141946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c22a-88ed-41a1-b888-de5dad4a0339 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:16.146511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75203c5-b820-4c11-8d90-679f0dbfd12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:16.147213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75203c5-b820-4c11-8d90-679f0dbfd12d admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.147500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75203c5-b820-4c11-8d90-679f0dbfd12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.147780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75203c5-b820-4c11-8d90-679f0dbfd12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.148510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75203c5-b820-4c11-8d90-679f0dbfd12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:16.150109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75203c5-b820-4c11-8d90-679f0dbfd12d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.160978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1147/2224] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:16.165257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:16.175410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece65204-77c7-42ed-82e4-23d56071e566 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:16.179991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:16.180871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.181662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.181662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] PATH_INFO: `/v3/projects/9a752fe439f0479b9e9a3d0ca92f31e0/users/f03f640ba36542dfbd86b0de3a223805/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.196573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a752fe439f0479b9e9a3d0ca92f31e0, user_id=f03f640ba36542dfbd86b0de3a223805, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:16.199295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.339274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1078/2225] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:16 2022] PUT /identity/v3/projects/9a752fe439f0479b9e9a3d0ca92f31e0/users/f03f640ba36542dfbd86b0de3a223805/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:16.352249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.352540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.352818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.385665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] MFA Rules not processed for user `f03f640ba36542dfbd86b0de3a223805`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:16.386946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:16.429045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:16.462615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1148/2226] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:16.475654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:16.477407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:16.536299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be809f-c004-422b-aa09-93dff7177deb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:16.540089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:16.540736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.541020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.541297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.550379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:16.551843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.560661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1079/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:16.580997 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:16.628709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:16.645535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f7bc-4817-429d-8c29-d8b3c208c152 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:16.650329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:16.651258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.651539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.651858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] PATH_INFO: `/v3/users/f03f640ba36542dfbd86b0de3a223805` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.653106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03f640ba36542dfbd86b0de3a223805)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:16.655280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.711750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:16.713202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:16.727410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd9fb-354c-4193-b62c-0dfb86c8cef7 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:16.732043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:16.732906 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:16.733194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:16.733536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] PATH_INFO: `/v3/users/fd2b74ad99d6462db6f51d146bbcf65c` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:16.735614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2b74ad99d6462db6f51d146bbcf65c)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:16.737524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:16.887862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03f640ba36542dfbd86b0de3a223805'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:16.947403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2b74ad99d6462db6f51d146bbcf65c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:16.994520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03f640ba36542dfbd86b0de3a223805'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:16.995483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03f640ba36542dfbd86b0de3a223805'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.003733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03f640ba36542dfbd86b0de3a223805'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.017481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ae0fcebe-1073-4a28-bc8e-be58dc19ee18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03f640ba36542dfbd86b0de3a223805'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.024018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1149/2228] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:16 2022] DELETE /identity/v3/users/f03f640ba36542dfbd86b0de3a223805 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:17.031188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d859e-be1e-466b-9c93-7e96481dd593 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:17.031568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d859e-be1e-466b-9c93-7e96481dd593 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:17.031845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d859e-be1e-466b-9c93-7e96481dd593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:17.052067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-102d859e-be1e-466b-9c93-7e96481dd593 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:17.053308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-102d859e-be1e-466b-9c93-7e96481dd593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:17.081152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2b74ad99d6462db6f51d146bbcf65c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.096440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2b74ad99d6462db6f51d146bbcf65c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.097468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2b74ad99d6462db6f51d146bbcf65c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.105039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2b74ad99d6462db6f51d146bbcf65c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.114152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1080/2229] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:16 2022] DELETE /identity/v3/users/fd2b74ad99d6462db6f51d146bbcf65c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:17.114551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1150/2230] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:17.119290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:17.119580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:17.119856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:17.124659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:17.126362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:17.138883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:17.140122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:17.198392 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6515-ac1e-4176-99ae-954e09ed1a61 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:17.208411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:17.209206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:17.209614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:17.209978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:17.212601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1151/2231] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:17.223825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:17.225778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:17.227370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:17.229215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:17.239345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af2c2-5147-41f3-b03f-3ac1e7236265 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:17.240338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1081/2232] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:17.243418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:17.244359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:17.244644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:17.244977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:17.259122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:17.260671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:17.271819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1152/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:17.800175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:17.801649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:17.821634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995979cc-0189-47b6-8bb9-b81062bc4dfd service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:17.822641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:17.824071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:17.834094 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:17.835363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:17.835768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:17.836115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] PATH_INFO: `/v3/projects/9a752fe439f0479b9e9a3d0ca92f31e0` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:17.837517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a752fe439f0479b9e9a3d0ca92f31e0)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:17.839346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f90e7-799d-4c78-bc37-93cc90dead43 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:17.839902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:17.846051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:17.848412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:17.848412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:17.848412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] PATH_INFO: `/v3/projects/1df5e6200e84462b8e39b7cfcacc1c3e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:17.849241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df5e6200e84462b8e39b7cfcacc1c3e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:17.851334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:17.897231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:17.966473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a752fe439f0479b9e9a3d0ca92f31e0', 'request_id': 'req-e6bd8bcd-29b6-4125-9dec-0e705a958c07'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.973822 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a752fe439f0479b9e9a3d0ca92f31e0', 'request_id': 'req-e6bd8bcd-29b6-4125-9dec-0e705a958c07'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:17.980191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:17.997900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df5e6200e84462b8e39b7cfcacc1c3e', 'request_id': 'req-abd1635e-0eff-45d7-be86-325b57b2a37c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.004805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df5e6200e84462b8e39b7cfcacc1c3e', 'request_id': 'req-abd1635e-0eff-45d7-be86-325b57b2a37c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.125760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a752fe439f0479b9e9a3d0ca92f31e0', 'request_id': 'req-e6bd8bcd-29b6-4125-9dec-0e705a958c07'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.137858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] The token cache is being invalidate because project 9a752fe439f0479b9e9a3d0ca92f31e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:18.138215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.138947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-e6bd8bcd-29b6-4125-9dec-0e705a958c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.141757 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1082/2234] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:17 2022] DELETE /identity/v3/projects/9a752fe439f0479b9e9a3d0ca92f31e0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:18.146381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1b73-81bc-4180-8335-ffbfdb3cf056 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.146905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1b73-81bc-4180-8335-ffbfdb3cf056 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.147187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1b73-81bc-4180-8335-ffbfdb3cf056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.166772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-027d1b73-81bc-4180-8335-ffbfdb3cf056 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:18.168144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-027d1b73-81bc-4180-8335-ffbfdb3cf056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:18.213554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df5e6200e84462b8e39b7cfcacc1c3e', 'request_id': 'req-abd1635e-0eff-45d7-be86-325b57b2a37c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.229760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] The token cache is being invalidate because project 1df5e6200e84462b8e39b7cfcacc1c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:18.230086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.230784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.232418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1153/2235] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:17 2022] DELETE /identity/v3/projects/1df5e6200e84462b8e39b7cfcacc1c3e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:18.236842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.237000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1083/2236] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:18.245138 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:18.245646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.245902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.246230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.259281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1635e-0eff-45d7-be86-325b57b2a37c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.265597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.266677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.267057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.267183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:18.267352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] PATH_INFO: `/v3/users/83443948cd97411e9680d4d8580d1aa6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.268365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:18.268811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83443948cd97411e9680d4d8580d1aa6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.270999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.277037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1084/2237] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:18.287892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.297626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06e75-b0e9-41fa-beed-a1732a4615e2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.302913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.303789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.304252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.304537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.305266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:18.305576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.307245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.319525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1085/2238] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:18.324209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.335372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75fc0-8e16-4aeb-aefb-3d93ec42310e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.340200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.340985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.341325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.345545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.345545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.345545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.491041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1086/2239] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:18 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:18.493235 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.550893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:18.560923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989dbc-4d99-4922-a98b-b6faa08ddbe0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.566277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.566983 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.567277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.567558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.568256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.569370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83443948cd97411e9680d4d8580d1aa6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.570167 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.664496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83443948cd97411e9680d4d8580d1aa6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.665418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83443948cd97411e9680d4d8580d1aa6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.671253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1087/2240] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:18 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:48:18.674259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83443948cd97411e9680d4d8580d1aa6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.675622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.677968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:18.679249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:18.687110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83443948cd97411e9680d4d8580d1aa6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:18.691998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca8fd5-e8a8-4061-add0-3c65b0eeec41 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.693382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1154/2241] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:18 2022] DELETE /identity/v3/users/83443948cd97411e9680d4d8580d1aa6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:18.756905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.757587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.757870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.758148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.758955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.760661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.779452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1088/2242] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:48:18.779986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.792797 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c558c-2eef-44e0-953e-609f2a58da80 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.803769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.805254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:18.817410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.818513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.819518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.820119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.820645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0c05-2198-4229-a4ba-9c5493bceed0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.821466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.824542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.826472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.827483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.828574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.829098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] PATH_INFO: `/v3/users/329b1e66d97d4cc2b0078454d21fac5e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.830490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=329b1e66d97d4cc2b0078454d21fac5e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.832581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:18.839300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1155/2243] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:18.846064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:18.857740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0371-41f0-4010-af73-a461f61dea75 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:18.864068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b2e62-0028-403f-9ff5-7880c1f58277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:18.865177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b2e62-0028-403f-9ff5-7880c1f58277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:18.865456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b2e62-0028-403f-9ff5-7880c1f58277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:18.865850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b2e62-0028-403f-9ff5-7880c1f58277 admin admin] PATH_INFO: `/v3/projects/e9c37473c6b048958877c0153409945e/users/c9294cd4fe044e518b84dc9e1b23b708/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:18.883872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b2e62-0028-403f-9ff5-7880c1f58277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c37473c6b048958877c0153409945e, user_id=c9294cd4fe044e518b84dc9e1b23b708, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:18.886550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b2e62-0028-403f-9ff5-7880c1f58277 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:19.008131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1156/2244] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:18 2022] PUT /identity/v3/projects/e9c37473c6b048958877c0153409945e/users/c9294cd4fe044e518b84dc9e1b23b708/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:19.019346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.019626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.019902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.059893 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '329b1e66d97d4cc2b0078454d21fac5e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.061554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] MFA Rules not processed for user `c9294cd4fe044e518b84dc9e1b23b708`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:19.063885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.140135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1157/2245] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:19.171687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.173264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.182826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '329b1e66d97d4cc2b0078454d21fac5e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.206641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '329b1e66d97d4cc2b0078454d21fac5e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.207649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '329b1e66d97d4cc2b0078454d21fac5e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.224028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '329b1e66d97d4cc2b0078454d21fac5e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.238662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1089/2246] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:18 2022] DELETE /identity/v3/users/329b1e66d97d4cc2b0078454d21fac5e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:19.239931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.246504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.252197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ba98-c007-41a9-ab28-a6672b18e97e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:19.323149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:19.324298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.324788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.326106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.330962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.339586 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd43d-a67f-4fda-b987-04b706104497 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:19.348557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:19.358314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.358314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.358314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] PATH_INFO: `/v3/projects/45688c16890245bca8deaa82c08cced6` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.358314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=45688c16890245bca8deaa82c08cced6)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:19.358314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:19.381411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:19.408686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:19.409969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230a7eb-879e-45fc-992b-a781b423727f service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:19.429133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1158/2247] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:19.430618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.431010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.431382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.449832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:19.451220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.460093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1159/2248] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:19.460948 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.462259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.475063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809e553-e73e-40dd-a832-c095781ab8d9 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:19.479785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:19.480640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.480923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.481199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] PATH_INFO: `/v3/users/c9294cd4fe044e518b84dc9e1b23b708` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.482396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9294cd4fe044e518b84dc9e1b23b708)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:19.485264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:19.517561 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45688c16890245bca8deaa82c08cced6', 'request_id': 'req-d0143397-79ce-4e24-82b9-540c936091ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.523982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45688c16890245bca8deaa82c08cced6', 'request_id': 'req-d0143397-79ce-4e24-82b9-540c936091ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.624192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45688c16890245bca8deaa82c08cced6', 'request_id': 'req-d0143397-79ce-4e24-82b9-540c936091ac'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.635965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] The token cache is being invalidate because project 45688c16890245bca8deaa82c08cced6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:19.636256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.636897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.638539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1090/2249] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:19 2022] DELETE /identity/v3/projects/45688c16890245bca8deaa82c08cced6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:19.639408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.641089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.698164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0143397-79ce-4e24-82b9-540c936091ac admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:19.702055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:19.702941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.703268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.703573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.705418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.708163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9294cd4fe044e518b84dc9e1b23b708'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.739399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:19.777225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:19.777225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b043b-9e6f-4e97-87fb-c940054889e3 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:19.785996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1091/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:19.792474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f0cc-8979-4201-a70c-9003a27a0318 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.792787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f0cc-8979-4201-a70c-9003a27a0318 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.793138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f0cc-8979-4201-a70c-9003a27a0318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.801967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9294cd4fe044e518b84dc9e1b23b708'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.802848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9294cd4fe044e518b84dc9e1b23b708'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.814382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9294cd4fe044e518b84dc9e1b23b708'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.814604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1541f0cc-8979-4201-a70c-9003a27a0318 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:19.815834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1541f0cc-8979-4201-a70c-9003a27a0318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.826756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1092/2251] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:19.830305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-fbc789d5-8cf2-47d3-99af-9df372691d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9294cd4fe044e518b84dc9e1b23b708'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:19.831860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.832150 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.832447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.837405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1160/2252] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:19 2022] DELETE /identity/v3/users/c9294cd4fe044e518b84dc9e1b23b708 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:19.842376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.842815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.843097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.852501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:19.853756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.863777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:19.865235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.917192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1093/2253] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:19.922097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.931268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7216-3ea0-44e3-8c56-7708ba9f1b1b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:19.931749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1161/2254] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:19.936264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:19.936918 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.937778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.938063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.938840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:19.939147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:19.940878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:19.941192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.942524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:19.952615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1094/2255] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:48:19.957515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:19.967068 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f641d-a504-4042-9046-41460679cc2a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:19.973817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:19.974514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:19.975041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:19.975289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:19.976441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:19.978809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.003902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baef10-77a9-4e78-981e-48e46f28f9ea None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.007913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.008726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.009320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.009320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.019302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.020775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.034823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1162/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:48:20.090970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1095/2257] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:19 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:48:20.095983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.106015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f1c63-5cda-4586-9b88-91c803154a37 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.173978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.174824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.175537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.175815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.176536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.179769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.243246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.246092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.264031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f64a2-c29d-4179-9949-f530458119ff admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.269625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.270747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.270876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.271109 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] PATH_INFO: `/v3/projects/b9811abe0486482b93ea47b99bc5ba9e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.272337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9811abe0486482b93ea47b99bc5ba9e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.274943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.308785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1163/2258] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:20 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:20.313723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.324340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a97ea-b92b-4008-b4c5-9da7e906cb24 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.328266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:20.332440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.333127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.333419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.333659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.334402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.336195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.348900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1164/2259] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:48:20.359055 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.370267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f07a2-c635-42cc-a95b-ee403fc18944 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.375422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.376115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.376403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.376678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.377416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.379199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.396801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1165/2260] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:20.402371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.413646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9811abe0486482b93ea47b99bc5ba9e', 'request_id': 'req-981deec5-5303-4504-b9bc-1e9a0ea29b2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.416677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533335-2f32-419b-85ce-4ab209204c53 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.425499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9811abe0486482b93ea47b99bc5ba9e', 'request_id': 'req-981deec5-5303-4504-b9bc-1e9a0ea29b2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.509622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9811abe0486482b93ea47b99bc5ba9e', 'request_id': 'req-981deec5-5303-4504-b9bc-1e9a0ea29b2a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.522155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5f8a3-7994-45f6-8142-06c8a4173a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.522914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] The token cache is being invalidate because project b9811abe0486482b93ea47b99bc5ba9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:20.523189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f8a3-7994-45f6-8142-06c8a4173a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.523322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.523506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f8a3-7994-45f6-8142-06c8a4173a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.523847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f8a3-7994-45f6-8142-06c8a4173a5d admin admin] PATH_INFO: `/v3/projects/d6df760900254f4a8bf1bce42c406e9b/users/6b4f9391ce984f25ae3230a408cfab54/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.523950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.526211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1096/2261] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:20 2022] DELETE /identity/v3/projects/b9811abe0486482b93ea47b99bc5ba9e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:20.534750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:20.550261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f8a3-7994-45f6-8142-06c8a4173a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6df760900254f4a8bf1bce42c406e9b, user_id=6b4f9391ce984f25ae3230a408cfab54, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.553107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f8a3-7994-45f6-8142-06c8a4173a5d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.588854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.590360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.616298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981deec5-5303-4504-b9bc-1e9a0ea29b2a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.621861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.622953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.623244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.623524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] PATH_INFO: `/v3/projects/e9c37473c6b048958877c0153409945e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.625113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c37473c6b048958877c0153409945e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.627262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.670791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:20.672580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1166/2262] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:20 2022] PUT /identity/v3/projects/d6df760900254f4a8bf1bce42c406e9b/users/6b4f9391ce984f25ae3230a408cfab54/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:20.689574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.689779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.689957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.754865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] MFA Rules not processed for user `6b4f9391ce984f25ae3230a408cfab54`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:20.755492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c37473c6b048958877c0153409945e', 'request_id': 'req-036f6e2f-8f58-4061-aa72-2ccbcb91a208'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.762095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c37473c6b048958877c0153409945e', 'request_id': 'req-036f6e2f-8f58-4061-aa72-2ccbcb91a208'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.763121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.845453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1167/2263] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:20.846090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c37473c6b048958877c0153409945e', 'request_id': 'req-036f6e2f-8f58-4061-aa72-2ccbcb91a208'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.858135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:20.860127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.861422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] The token cache is being invalidate because project e9c37473c6b048958877c0153409945e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:20.861690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.862413 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-036f6e2f-8f58-4061-aa72-2ccbcb91a208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:20.867542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1097/2264] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:20 2022] DELETE /identity/v3/projects/e9c37473c6b048958877c0153409945e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:20.870825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307623-72c6-498f-97fc-6f310073518b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.871079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307623-72c6-498f-97fc-6f310073518b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.871360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307623-72c6-498f-97fc-6f310073518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.894112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d9307623-72c6-498f-97fc-6f310073518b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:20.895468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d9307623-72c6-498f-97fc-6f310073518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.922382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9591-582f-4548-9605-1ec6522a26fa None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:20.926139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:20.926818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.927104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.927378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.929178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.942500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:20.943990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092fa05-efba-4aa3-a80a-6e25518a4677 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:20.953682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1168/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:20.957451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1098/2266] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:20.965310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:20.965600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:20.965882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:20.984561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:20.985769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:20.997157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1169/2267] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:21.006673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9307623-72c6-498f-97fc-6f310073518b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.018287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9307623-72c6-498f-97fc-6f310073518b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.023062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.023721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.024008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.024284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.025014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:21.025322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.026941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.039568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1099/2268] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:21.045533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.054908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739e47-195e-4ed8-8fda-4022fd84ee5c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.059580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.060237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.060518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.060785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.061489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.063476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.175722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1170/2269] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:21 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:21.179897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.191467 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae186-55c3-4c04-8c4b-ace18448f571 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.255841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.256609 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.256960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.257372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.258149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.260247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.379987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1100/2270] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:21 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:21.383856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.394658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c089a-4eac-43cd-a6e3-90163324a41b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.399555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.400281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.400575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.400921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.401589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.403288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.415067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1171/2271] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:21.418943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.430800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6b32-3a62-42c2-aca4-060891170f20 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.435782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d1945-f6c6-454d-a169-e62cb4f91942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.436455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d1945-f6c6-454d-a169-e62cb4f91942 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.436745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d1945-f6c6-454d-a169-e62cb4f91942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.437053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d1945-f6c6-454d-a169-e62cb4f91942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.438313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d1945-f6c6-454d-a169-e62cb4f91942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.440080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d1945-f6c6-454d-a169-e62cb4f91942 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.454400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1101/2272] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:21.455639 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.466211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a8fb-dd7f-45d4-98bc-ec65a2167fae admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.470942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.471838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.472126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.472410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] PATH_INFO: `/v3/projects/c4e99693031b4e5aa1cfab4be33934ea/users/5af5d43628dd4ab387c64324eed5ccc7/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.489068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e99693031b4e5aa1cfab4be33934ea, user_id=5af5d43628dd4ab387c64324eed5ccc7, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.492194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.631804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1172/2273] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:21 2022] PUT /identity/v3/projects/c4e99693031b4e5aa1cfab4be33934ea/users/5af5d43628dd4ab387c64324eed5ccc7/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:48:21.636911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30e44-a19b-43dc-b15d-435ffcb42a50 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.637203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30e44-a19b-43dc-b15d-435ffcb42a50 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.637487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30e44-a19b-43dc-b15d-435ffcb42a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.656296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-fca30e44-a19b-43dc-b15d-435ffcb42a50 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:21.657625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fca30e44-a19b-43dc-b15d-435ffcb42a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:21.732548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1102/2274] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:21.744840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:21.747052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:21.815211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:21.842540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678dba-d13f-4276-83e9-6cb59743837c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:21.846918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:21.847586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:21.847870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:21.848195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:21.874049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:21.876389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:21.900059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1173/2275] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:22.037126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:22.824976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:23.022944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:23.547204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e611-5109-48da-905b-2c473ec26cf4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:23.560479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e611-5109-48da-905b-2c473ec26cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:23.560479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e611-5109-48da-905b-2c473ec26cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:23.583322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7d88e611-5109-48da-905b-2c473ec26cf4 None None] MFA Rules not processed for user `5af5d43628dd4ab387c64324eed5ccc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:23.584799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7d88e611-5109-48da-905b-2c473ec26cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:23.674860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1103/2276] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:23.684071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:23.685648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:23.760306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9c65-f722-459f-be0f-5c53496e0afc service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:23.770334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8485-1d96-4099-9a88-148d8c596161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:23.771277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8485-1d96-4099-9a88-148d8c596161 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:23.779799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8485-1d96-4099-9a88-148d8c596161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:23.780077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8485-1d96-4099-9a88-148d8c596161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:23.792168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e8485-1d96-4099-9a88-148d8c596161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:23.793652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e8485-1d96-4099-9a88-148d8c596161 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:23.803205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1174/2277] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:24.014490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:24.396439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:24.894774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:25.023295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:25.040259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1219-9880-4611-8f8c-d2e5de568aa0 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:25.040941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1219-9880-4611-8f8c-d2e5de568aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:25.041552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1219-9880-4611-8f8c-d2e5de568aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:25.064652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8bae1219-9880-4611-8f8c-d2e5de568aa0 None None] MFA Rules not processed for user `d1282d4187a54299836bb6b4300d15c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:25.066487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8bae1219-9880-4611-8f8c-d2e5de568aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:25.124045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1104/2278] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:26.123825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:26.447825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:26.844456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:26.844598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:26.844807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:26.864626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] MFA Rules not processed for user `5af5d43628dd4ab387c64324eed5ccc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:26.865886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:26.873942 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1175/2279] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:28.264909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:28.549388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:29.447219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:30.355043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:31.681842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:32.134087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:32.479528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7a88-3334-4a11-a7f1-62b35814b388 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:32.479876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7a88-3334-4a11-a7f1-62b35814b388 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:32.480233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7a88-3334-4a11-a7f1-62b35814b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:32.498412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b1ec7a88-3334-4a11-a7f1-62b35814b388 None None] MFA Rules not processed for user `12305af61a2941fe81075b7e6609c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:32.499748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b1ec7a88-3334-4a11-a7f1-62b35814b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:32.558354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1105/2280] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:33.668283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:33.669715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:33.683364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa664be-c46c-4638-bb97-039a52f9fa9e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:33.687815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:33.688677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:33.688959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:33.689233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] PATH_INFO: `/v3/users/da7b029c64b54365a20753ef3b91e6ee` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:33.690458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7b029c64b54365a20753ef3b91e6ee)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:33.692430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:33.950480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7b029c64b54365a20753ef3b91e6ee'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:34.041099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7b029c64b54365a20753ef3b91e6ee'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:34.042191 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7b029c64b54365a20753ef3b91e6ee'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:34.061140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7b029c64b54365a20753ef3b91e6ee'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:34.078263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7b029c64b54365a20753ef3b91e6ee'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:34.090825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1176/2281] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:48:33 2022] DELETE /identity/v3/users/da7b029c64b54365a20753ef3b91e6ee => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:34.091907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:34.092358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:34.092473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:34.149778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:34.151804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:34.208801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:34.235115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1106/2282] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:48:34.246176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:34.247745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:34.307031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb216-292a-44bf-862f-bdce320fc454 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:34.310575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706fc8-d1b2-483e-b38d-026d1c303e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:34.311269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706fc8-d1b2-483e-b38d-026d1c303e3a service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:34.311551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706fc8-d1b2-483e-b38d-026d1c303e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:34.311826 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706fc8-d1b2-483e-b38d-026d1c303e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:34.322094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706fc8-d1b2-483e-b38d-026d1c303e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:34.325680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706fc8-d1b2-483e-b38d-026d1c303e3a service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:34.335557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1177/2283] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:34.865098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:34.866649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:34.893536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9c666-2932-4f4d-aee8-55da536a6cdb None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:34.900690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:34.901610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:34.901895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:34.902171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] PATH_INFO: `/v3/projects/0a5aec34986e4c23a39e3b7f87d6e6c5` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:34.903510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5aec34986e4c23a39e3b7f87d6e6c5)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:34.920748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:35.061884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5aec34986e4c23a39e3b7f87d6e6c5', 'request_id': 'req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:35.069532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5aec34986e4c23a39e3b7f87d6e6c5', 'request_id': 'req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:35.123805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:35.160133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5aec34986e4c23a39e3b7f87d6e6c5', 'request_id': 'req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:35.178513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] The token cache is being invalidate because project 0a5aec34986e4c23a39e3b7f87d6e6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:48:35.179106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:35.179992 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7e062e9d-84d8-4211-b3ac-9bc159a77b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:48:35.189470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1107/2284] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:48:34 2022] DELETE /identity/v3/projects/0a5aec34986e4c23a39e3b7f87d6e6c5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:35.194884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.195272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.195436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.222603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:35.240449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:35.306926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1178/2285] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:35.314670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.315137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.315432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.338788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:35.338788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:35.347821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1108/2286] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:35.352194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:35.362934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4e5cd-463c-437f-8054-9572658b9884 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:35.368629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:35.369351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.369891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.370167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.370936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:48:35.371253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:35.384957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:35.430099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1179/2287] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:48:35.430550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:35.432065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee551a-6061-4dc6-ba9e-fa8eac469684 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:35.439262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:35.440146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.441243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.441590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.442307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:35.444677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:35.568572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1109/2288] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:35 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:35.572840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:35.583716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a3f8-4c7b-4464-a2d8-aefef940dcc3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:35.641766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:35.642452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.642823 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.643103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.644040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:35.646044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:35.762898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1180/2289] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:35 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:35.767611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:35.786713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409151-129e-4a76-8040-b98d18acac5f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:35.793173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:35.794055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.794506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.795086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.796079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:35.798355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:35.810259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1110/2290] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:35.814452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:35.835580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680bd0-f615-4a15-97ba-a9ed7053248e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:35.842732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eab64-526e-4d8f-be24-b3144c892383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:35.842732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eab64-526e-4d8f-be24-b3144c892383 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.842732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eab64-526e-4d8f-be24-b3144c892383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.842732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eab64-526e-4d8f-be24-b3144c892383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.843085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eab64-526e-4d8f-be24-b3144c892383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:35.844343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eab64-526e-4d8f-be24-b3144c892383 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:35.857241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1181/2291] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:35.861170 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:35.876627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302d5a-95d2-41b8-867a-87cec8a156d2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:35.882468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:35.883537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:35.883887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:35.884230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] PATH_INFO: `/v3/projects/63ca0d9866c946cfa7368f14dd428b6d/users/aa44dda2c1a8450a9e0b3e1176de5686/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:35.905172 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ca0d9866c946cfa7368f14dd428b6d, user_id=aa44dda2c1a8450a9e0b3e1176de5686, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:35.908258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:36.004151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1111/2292] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:35 2022] PUT /identity/v3/projects/63ca0d9866c946cfa7368f14dd428b6d/users/aa44dda2c1a8450a9e0b3e1176de5686/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:36.009269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebd260-bd6b-4742-ac2a-280d0f22ca31 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:36.009558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebd260-bd6b-4742-ac2a-280d0f22ca31 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:36.009838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebd260-bd6b-4742-ac2a-280d0f22ca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:36.026629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:36.034144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d0ebd260-bd6b-4742-ac2a-280d0f22ca31 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:36.036199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d0ebd260-bd6b-4742-ac2a-280d0f22ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:36.105197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1182/2293] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:36.115772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:36.117433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:36.176588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2cab9-dd60-40da-9710-595c6f53cf17 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:36.180338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:36.180996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:36.181268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:36.181543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:36.191679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:36.193106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:36.202889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1112/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:36.780718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:38.248888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:38.339974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:39.089281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb21b1-cc92-4266-88fc-98657241c1d7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:39.089574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb21b1-cc92-4266-88fc-98657241c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:39.089850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb21b1-cc92-4266-88fc-98657241c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:39.154164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4bdb21b1-cc92-4266-88fc-98657241c1d7 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:39.157296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4bdb21b1-cc92-4266-88fc-98657241c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:39.180387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:39.288250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1183/2295] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:48:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:39.289118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:39.290565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:39.391862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d19f7-8edd-4eb5-af08-828908971e15 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:39.401842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:39.403204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:39.403644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:39.404073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:39.414849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:39.417678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:39.439064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1113/2296] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:48:40.102152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:40.730908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:41.300795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:41.974335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:43.963117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:45.049720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:45.050762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:45.051220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:45.100241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] MFA Rules not processed for user `aa44dda2c1a8450a9e0b3e1176de5686`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:45.101522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:45.112940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:45.194405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1184/2297] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:45.195585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:45.255428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e575-e4b6-47e1-9dc4-85bed7c5019d service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:45.264867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:45.266088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:45.266780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:45.269461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:45.270535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:45.272673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:45.421214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1114/2298] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:48:45 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:45.425185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:45.448355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dbf7b-08f7-4892-8c2e-046b87aa268c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:45.552979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:45.594828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:45.595081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:45.595465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:45.595838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:45.596685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:45.599797 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:45.898881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1185/2299] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:48:45 2022] POST /identity/v3/users => generated 292 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:48:45.902507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:45.915343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac612ba-4af3-4d14-bc98-0c2cbbc78421 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:45.923610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:45.924433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:45.924819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:45.925850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:45.929161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:45.930770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:45.952605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1115/2300] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:48:45.969002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:46.001985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693ff4-27cb-434e-8777-e4adcd896419 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:46.012457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:46.013610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:46.014030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:46.014488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] PATH_INFO: `/v3/projects/9ad51d352c76478a906873ff870aec90/users/0cabf5554f0a4ce68fd84f211ca6e9af/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:46.042618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad51d352c76478a906873ff870aec90, user_id=0cabf5554f0a4ce68fd84f211ca6e9af, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:46.052377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:46.163395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1186/2301] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:45 2022] PUT /identity/v3/projects/9ad51d352c76478a906873ff870aec90/users/0cabf5554f0a4ce68fd84f211ca6e9af/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:46.167448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:46.183897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520b93e-0324-44c7-9c25-db1da5dc234f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:46.268950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8e8a-08c7-432b-9f5b-046004a5d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:46.270856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8e8a-08c7-432b-9f5b-046004a5d3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:46.271810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8e8a-08c7-432b-9f5b-046004a5d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:46.272554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8e8a-08c7-432b-9f5b-046004a5d3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:46.273722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb8e8a-08c7-432b-9f5b-046004a5d3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:46.279389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb8e8a-08c7-432b-9f5b-046004a5d3e3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:46.291840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1116/2302] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:48:46.295795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:46.312955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9574f-697d-46c3-b6ca-82b9ed15ba63 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:46.326212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:46.327197 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:46.327485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:46.327771 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] PATH_INFO: `/v3/projects/9ad51d352c76478a906873ff870aec90/users/0cabf5554f0a4ce68fd84f211ca6e9af/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:46.331168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad51d352c76478a906873ff870aec90, user_id=0cabf5554f0a4ce68fd84f211ca6e9af, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:46.342053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:46.358228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1187/2303] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:48:46 2022] PUT /identity/v3/projects/9ad51d352c76478a906873ff870aec90/users/0cabf5554f0a4ce68fd84f211ca6e9af/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:48:47.100229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:47.752036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:48.320643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:49.002959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:49.448003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:50.117177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:56.275297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d1a96-894c-4822-ab35-65f35da3db21 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:56.277523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d1a96-894c-4822-ab35-65f35da3db21 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:56.277960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d1a96-894c-4822-ab35-65f35da3db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:56.334932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-620d1a96-894c-4822-ab35-65f35da3db21 None None] MFA Rules not processed for user `0cabf5554f0a4ce68fd84f211ca6e9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:56.337544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-620d1a96-894c-4822-ab35-65f35da3db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:56.473138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1117/2304] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:48:56.492148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:48:56.495903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:56.633971 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:56.648631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4aafc-e3dc-48a4-b6b4-21231dd771b2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:48:56.655177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f3b9-6505-47fa-9888-50962e92929f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:48:56.656264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f3b9-6505-47fa-9888-50962e92929f service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:56.656264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f3b9-6505-47fa-9888-50962e92929f service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:56.658634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f3b9-6505-47fa-9888-50962e92929f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:56.776460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f3b9-6505-47fa-9888-50962e92929f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:48:56.779046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f3b9-6505-47fa-9888-50962e92929f service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:48:56.809144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1188/2305] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:48:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:48:57.561993 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:48:57.562556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:48:57.562556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:48:57.590072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] MFA Rules not processed for user `5af5d43628dd4ab387c64324eed5ccc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:48:57.592091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:48:57.655879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:57.675975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1118/2306] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:48:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:01.659565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58c79-f080-4c41-b8ab-1b49306b85c6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:01.660255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58c79-f080-4c41-b8ab-1b49306b85c6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:01.660255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58c79-f080-4c41-b8ab-1b49306b85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:01.677354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9bb58c79-f080-4c41-b8ab-1b49306b85c6 None None] MFA Rules not processed for user `aa44dda2c1a8450a9e0b3e1176de5686`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:01.678557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9bb58c79-f080-4c41-b8ab-1b49306b85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:01.685440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1189/2307] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:03.838771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:03.840285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:03.908899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f11f0-68bf-4d8e-9a28-7e649712a4fd None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:03.913818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:03.914712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:03.915018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:03.915297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] PATH_INFO: `/v3/users/6b4f9391ce984f25ae3230a408cfab54` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:03.916496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4f9391ce984f25ae3230a408cfab54)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:03.918452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:04.102382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4f9391ce984f25ae3230a408cfab54'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:04.162914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4f9391ce984f25ae3230a408cfab54'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:04.177027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4f9391ce984f25ae3230a408cfab54'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:04.177752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4f9391ce984f25ae3230a408cfab54'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:04.184557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4f9391ce984f25ae3230a408cfab54'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:04.190387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1119/2308] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:49:03 2022] DELETE /identity/v3/users/6b4f9391ce984f25ae3230a408cfab54 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:04.194902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:04.195424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:04.195523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:04.213716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:04.215007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:04.274957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1190/2309] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:04.284692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:04.286999 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:04.345878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1f73-b72e-48f1-97de-b6359a61e8a4 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:04.350583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98897b10-0515-47d6-ba5f-effe830e53af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:04.351262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897b10-0515-47d6-ba5f-effe830e53af service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:04.351547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897b10-0515-47d6-ba5f-effe830e53af service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:04.351817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897b10-0515-47d6-ba5f-effe830e53af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:04.360791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98897b10-0515-47d6-ba5f-effe830e53af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:04.362198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98897b10-0515-47d6-ba5f-effe830e53af service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:04.373040 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1120/2310] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:04.809291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:04.811506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:04.829009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff90a2-cc2c-48e2-9d37-b41e600374d2 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:04.837583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:04.839342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:04.839740 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:04.840019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] PATH_INFO: `/v3/projects/d6df760900254f4a8bf1bce42c406e9b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:04.848850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6df760900254f4a8bf1bce42c406e9b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:04.850729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:04.980752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6df760900254f4a8bf1bce42c406e9b', 'request_id': 'req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:04.986777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6df760900254f4a8bf1bce42c406e9b', 'request_id': 'req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:05.110593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6df760900254f4a8bf1bce42c406e9b', 'request_id': 'req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:05.122600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] The token cache is being invalidate because project d6df760900254f4a8bf1bce42c406e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:49:05.122906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:05.126282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3f73c5f4-88c5-454f-937d-c5ba7a25ee4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:49:05.126282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1191/2311] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:49:04 2022] DELETE /identity/v3/projects/d6df760900254f4a8bf1bce42c406e9b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:49:05.129990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.130466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.130562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.149541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:05.150088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:05.170117 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:05.222080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1121/2312] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:05.231531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.232057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.232057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.252704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:05.254064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:05.262633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1192/2313] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:05.268668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:05.280313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b1566-0bcf-4b43-bce8-c1426c96ebaa None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:05.285246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:05.286677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.286972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.287257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.288005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:49:05.288337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:05.289946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:05.302163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1122/2314] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:49:05.307057 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:05.317628 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4109d-ac6f-4277-9bfb-bbb683f344e1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:05.323764 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:05.324852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.325146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.325424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.326140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:05.328247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:05.337909 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:05.476014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1193/2315] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:49:05 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:49:05.480365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:05.493380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5f5d-54d1-4fdd-853c-a7e0c721d2e7 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:05.558817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:05.559501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.559790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.560069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.560812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:05.562795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:05.730445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1123/2316] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:49:05 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:49:05.735151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:05.753791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2fa2-9d1a-4c75-9ba9-373e026d57a0 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:05.759120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:05.759935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.760292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.760693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.761507 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:05.763340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:05.790526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1194/2317] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:49:05.791768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:05.802917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563b8a5-079e-4fcb-bf04-d6ce7f765b62 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:05.807944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9dc6d-b6e4-4cac-839c-f9b68d22bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:05.808619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9dc6d-b6e4-4cac-839c-f9b68d22bcdf admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.808902 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9dc6d-b6e4-4cac-839c-f9b68d22bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.809176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9dc6d-b6e4-4cac-839c-f9b68d22bcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.809970 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9dc6d-b6e4-4cac-839c-f9b68d22bcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:05.811621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9dc6d-b6e4-4cac-839c-f9b68d22bcdf admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:05.823044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1124/2318] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:49:05.826891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:05.838068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2555c-9e0a-4965-8457-da699a00bd28 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:05.842806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:05.843705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.843995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.844272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] PATH_INFO: `/v3/projects/41558c8833b44fe8ace40ccf418bc94e/users/7fabf88ca8954bc791ac01aebb221f8b/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:05.859723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41558c8833b44fe8ace40ccf418bc94e, user_id=7fabf88ca8954bc791ac01aebb221f8b, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:05.862383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:05.967215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1195/2319] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:49:05 2022] PUT /identity/v3/projects/41558c8833b44fe8ace40ccf418bc94e/users/7fabf88ca8954bc791ac01aebb221f8b/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:49:05.972234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b4434-530c-4143-96e6-3bfcca6dca56 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:05.972522 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b4434-530c-4143-96e6-3bfcca6dca56 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:05.972853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b4434-530c-4143-96e6-3bfcca6dca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:06.010878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5e5b4434-530c-4143-96e6-3bfcca6dca56 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:06.011680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5e5b4434-530c-4143-96e6-3bfcca6dca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:06.109674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1125/2320] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:06.120427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:06.123413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:06.202555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84925909-0ca2-4d12-b304-6ea4ebc4719d admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:06.206235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:06.206922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:06.207776 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:06.208272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:06.218317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:06.220226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:06.233080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1196/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:07.748378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f932e-d64b-4517-b8b2-f0de7c86e796 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:07.748880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f932e-d64b-4517-b8b2-f0de7c86e796 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:07.749102 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f932e-d64b-4517-b8b2-f0de7c86e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:07.780633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e88f932e-d64b-4517-b8b2-f0de7c86e796 None None] MFA Rules not processed for user `7fabf88ca8954bc791ac01aebb221f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:07.781803 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e88f932e-d64b-4517-b8b2-f0de7c86e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:07.806228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:07.858139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1126/2322] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:07.868775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:07.870282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:07.930019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29186cbc-7100-4517-b821-a6e1e16e5ff6 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:07.933953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0baf-852b-4ebb-8531-2b48ba51f7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:07.934651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0baf-852b-4ebb-8531-2b48ba51f7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:07.934986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0baf-852b-4ebb-8531-2b48ba51f7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:07.935267 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0baf-852b-4ebb-8531-2b48ba51f7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:07.944695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc0baf-852b-4ebb-8531-2b48ba51f7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:07.946142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc0baf-852b-4ebb-8531-2b48ba51f7a3 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:07.955547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1197/2323] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:08.148620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cc4b-91d3-4ac1-9efd-3a8c55b06950 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.149327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cc4b-91d3-4ac1-9efd-3a8c55b06950 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.149444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cc4b-91d3-4ac1-9efd-3a8c55b06950 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.150988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1127/2324] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:49:08.157105 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8580-261e-4c0b-98eb-299433db147a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.157394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8580-261e-4c0b-98eb-299433db147a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.157699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8580-261e-4c0b-98eb-299433db147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.180038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-72dd8580-261e-4c0b-98eb-299433db147a None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:08.181255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-72dd8580-261e-4c0b-98eb-299433db147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:08.237654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:08.255695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1198/2325] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:49:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:08.275786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cc4b-91d3-4ac1-9efd-3a8c55b06950 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:08.275786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cff9cc4b-91d3-4ac1-9efd-3a8c55b06950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:08.328192 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cc4b-91d3-4ac1-9efd-3a8c55b06950 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:08.331894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47436d-eab6-4e71-b7f8-0f9ffdbdb26f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:08.333291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47436d-eab6-4e71-b7f8-0f9ffdbdb26f service glance] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.333890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47436d-eab6-4e71-b7f8-0f9ffdbdb26f service glance] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.334171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47436d-eab6-4e71-b7f8-0f9ffdbdb26f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.345182 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47436d-eab6-4e71-b7f8-0f9ffdbdb26f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:08.346672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47436d-eab6-4e71-b7f8-0f9ffdbdb26f service glance] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:08.358976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1128/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:08.653006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054289a-643a-4698-bb43-98fcae089ba0 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.653295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054289a-643a-4698-bb43-98fcae089ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.653745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054289a-643a-4698-bb43-98fcae089ba0 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.655299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1199/2327] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:49:08.661251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34328bf9-e1c6-4853-ae11-ff0900d23ae5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.661539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34328bf9-e1c6-4853-ae11-ff0900d23ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.661814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34328bf9-e1c6-4853-ae11-ff0900d23ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.689933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-34328bf9-e1c6-4853-ae11-ff0900d23ae5 None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:08.692118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-34328bf9-e1c6-4853-ae11-ff0900d23ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:08.705769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1129/2328] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:49:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:08.718510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054289a-643a-4698-bb43-98fcae089ba0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:08.730085 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054289a-643a-4698-bb43-98fcae089ba0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:08.733715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeb77b-fe1c-4375-8041-a68e22008a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:08.734365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb77b-fe1c-4375-8041-a68e22008a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.734648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb77b-fe1c-4375-8041-a68e22008a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.734986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeb77b-fe1c-4375-8041-a68e22008a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.743008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb77b-fe1c-4375-8041-a68e22008a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:08.744452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeb77b-fe1c-4375-8041-a68e22008a3b service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:08.752648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1200/2329] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:08.882426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ecc9-9d10-4afe-af05-f5d10435a149 None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.883078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ecc9-9d10-4afe-af05-f5d10435a149 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.883195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ecc9-9d10-4afe-af05-f5d10435a149 None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.885146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1130/2330] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:49:08.890620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3f6ec-8851-400b-a595-c38c1a0b84f4 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.891052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3f6ec-8851-400b-a595-c38c1a0b84f4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.891300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3f6ec-8851-400b-a595-c38c1a0b84f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.909733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d6a3f6ec-8851-400b-a595-c38c1a0b84f4 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:08.911339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d6a3f6ec-8851-400b-a595-c38c1a0b84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:08.922845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1201/2331] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:49:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:08.934734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ecc9-9d10-4afe-af05-f5d10435a149 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:08.947032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ecc9-9d10-4afe-af05-f5d10435a149 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:08.951197 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd33ef-268d-4462-990b-8a0958e87131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:08.951843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd33ef-268d-4462-990b-8a0958e87131 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:08.952126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd33ef-268d-4462-990b-8a0958e87131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:08.952399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd33ef-268d-4462-990b-8a0958e87131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:08.963930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd33ef-268d-4462-990b-8a0958e87131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:08.965507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd33ef-268d-4462-990b-8a0958e87131 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:08.976675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1131/2332] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:09.817110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:09.817400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:09.817682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:09.836178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] MFA Rules not processed for user `7fabf88ca8954bc791ac01aebb221f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:09.837401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:09.844637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1202/2333] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:49:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:14.786828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:14.786828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:14.786828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:14.800539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:14.802141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:14.861038 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1132/2334] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:14.874469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:14.875898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:14.954314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9209eeb-62be-4c7b-86bf-715080ae6387 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:14.963483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:14.963483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:14.963483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:14.964049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:14.972547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:14.974435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:14.984586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1203/2335] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:49:24.854215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=79 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:24.981245 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=48 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:28.389814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:28.391224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:28.395801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:28.397331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:28.471171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2330e8-6fb5-484e-80de-50170a666978 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:28.477042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:28.478398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:28.478703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:28.478991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:28.480831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:28.482677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2beef-006e-4500-b7f9-1cc870a3cc1b service swift] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:28.487992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:28.488828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:28.489305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:28.489667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:28.493769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:28.495466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bbf1e-4053-4434-aa83-9c6a884c8809 service placement] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:28.513581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:28.513903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1133/2336] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:49:28.514001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:28.521894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1204/2337] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:49:37.071736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840161-d40f-4df1-994d-00b8016bfe77 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:37.072290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840161-d40f-4df1-994d-00b8016bfe77 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:37.072290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840161-d40f-4df1-994d-00b8016bfe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:37.098304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1e840161-d40f-4df1-994d-00b8016bfe77 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:37.100635 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1e840161-d40f-4df1-994d-00b8016bfe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:37.109245 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1134/2338] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:37.130154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:37.142633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dac29-3d71-4cea-acf0-ea3c8c6a0a97 service placement] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:37.151654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:37.152498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:37.152785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:37.153127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:37.169471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:37.171431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:37.196580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1205/2339] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:49:38.895380 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:38.900946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:38.900946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:38.949173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:49:38.950790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:38.967565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1135/2340] 10.222.0.49 () {58 vars in 967 bytes} [Thu Jul 21 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:49:38.989963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:39.007535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced71dc-5317-4a2b-9e9c-0a2f3b1b3c30 service swift] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:39.016475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a62e1-43d6-4943-9658-77113711e9b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:39.016608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a62e1-43d6-4943-9658-77113711e9b4 service swift] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:39.017028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a62e1-43d6-4943-9658-77113711e9b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:39.017414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a62e1-43d6-4943-9658-77113711e9b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:39.028800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a62e1-43d6-4943-9658-77113711e9b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:39.032697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a62e1-43d6-4943-9658-77113711e9b4 service swift] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:39.088404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1206/2341] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:49:48.921427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=38 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:49.076950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=44 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:51.167673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:49:51.177737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb27dd-26c2-4f51-85b4-5b52c619ce63 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:49:51.181505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:49:51.182147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:49:51.182438 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:49:51.182740 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:49:51.184506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:49:51.260472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:49:51.261954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:49:51.272181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1136/2342] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:01.267299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=30 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:03.019432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87dfdb-4299-4ffc-94a0-c3ae4c3dd184 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:03.019882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87dfdb-4299-4ffc-94a0-c3ae4c3dd184 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:03.019975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87dfdb-4299-4ffc-94a0-c3ae4c3dd184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:03.038193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-ca87dfdb-4299-4ffc-94a0-c3ae4c3dd184 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:03.039457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ca87dfdb-4299-4ffc-94a0-c3ae4c3dd184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:03.046910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1207/2343] 10.222.0.49 () {58 vars in 967 bytes} [Thu Jul 21 10:50:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:03.059269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:03.070769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75f1b-1fbd-4647-9ce9-c9b78dedee38 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:03.077947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fea092-d600-4bde-91e7-72caca66cf18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:03.077947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fea092-d600-4bde-91e7-72caca66cf18 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:03.077947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fea092-d600-4bde-91e7-72caca66cf18 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:03.077947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fea092-d600-4bde-91e7-72caca66cf18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:03.085958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fea092-d600-4bde-91e7-72caca66cf18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:03.087680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fea092-d600-4bde-91e7-72caca66cf18 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:03.095943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1137/2344] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:50:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:50:06.272746 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c90c71-f26c-4fa7-9507-ee248fb2d14f None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.273272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c90c71-f26c-4fa7-9507-ee248fb2d14f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.273443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c90c71-f26c-4fa7-9507-ee248fb2d14f None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.275117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1208/2345] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:50:06.291361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.291847 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.292064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.311973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] MFA Rules not processed for user `0d5034e89eb64bd6bbc0d02f2da909c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:06.313193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:06.322187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1138/2346] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:06.339139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c90c71-f26c-4fa7-9507-ee248fb2d14f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.353572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c90c71-f26c-4fa7-9507-ee248fb2d14f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.358504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.359314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.359539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.363956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.369450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.371178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.381480 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1209/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:06.428813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:06.430251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:06.446012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b13aa-f5c6-44e3-ae8e-cfcf69cc1c5d None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:06.450674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:06.451575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:06.451860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:06.452132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] PATH_INFO: `/v3/users/5af5d43628dd4ab387c64324eed5ccc7` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:06.453349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af5d43628dd4ab387c64324eed5ccc7)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:06.456171 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:06.655009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af5d43628dd4ab387c64324eed5ccc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:06.726550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af5d43628dd4ab387c64324eed5ccc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:06.738897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af5d43628dd4ab387c64324eed5ccc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:06.739560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af5d43628dd4ab387c64324eed5ccc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:06.746545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2436f5b5-a528-4e58-95d6-33a14a0792ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af5d43628dd4ab387c64324eed5ccc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:06.752600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1139/2348] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:06 2022] DELETE /identity/v3/users/5af5d43628dd4ab387c64324eed5ccc7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:07.009177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.023260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce2fe-bbb2-4ac2-82d4-2fcfaa111205 service placement] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.086647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.087560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.087865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.088136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] PATH_INFO: `/v3/projects/c4e99693031b4e5aa1cfab4be33934ea` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.089320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e99693031b4e5aa1cfab4be33934ea)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.091265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.178884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e99693031b4e5aa1cfab4be33934ea', 'request_id': 'req-703a90f6-107f-463f-b74b-eaeaa3a886c3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:07.185199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e99693031b4e5aa1cfab4be33934ea', 'request_id': 'req-703a90f6-107f-463f-b74b-eaeaa3a886c3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:07.275043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e99693031b4e5aa1cfab4be33934ea', 'request_id': 'req-703a90f6-107f-463f-b74b-eaeaa3a886c3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:07.285989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] The token cache is being invalidate because project c4e99693031b4e5aa1cfab4be33934ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:07.286274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:07.286928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-703a90f6-107f-463f-b74b-eaeaa3a886c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:07.288465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1210/2349] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:07 2022] DELETE /identity/v3/projects/c4e99693031b4e5aa1cfab4be33934ea => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:07.293333 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.293777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.293872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.314066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:07.315863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:07.381851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1140/2350] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:07.384153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.384153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.384389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.404844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:07.408389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:07.416688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1211/2351] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:07.421531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.431516 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde098b-44a9-498f-8b55-1bc8c9bd8a45 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.436018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.441431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.441431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.441431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.441431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:50:07.441431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.441431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.451642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1141/2352] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:50:07.456599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.465990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c0b6-8cde-4f61-b5b4-377dc214b69f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.471519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.472120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.472407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.472691 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.473389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.475353 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.585900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1212/2353] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:50:07 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:50:07.590096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.601033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64072e-60b7-4b18-bbd6-6ddf04f1ed28 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.641243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:07.660514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.661180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.661463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.661736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.662480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.664423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.749312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1142/2354] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:50:07 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:50:07.754269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.764883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f5b5-a78c-42b5-bc9b-aae845f6c318 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.776058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.776058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.776058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.776058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.776922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.776922 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.793701 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1213/2355] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:07.798774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.811524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62b5f9-2ab9-44fc-9573-1e3e357247b5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.817597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70840c-4d0f-4748-ba59-e9db77bb66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.818545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70840c-4d0f-4748-ba59-e9db77bb66e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.818935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70840c-4d0f-4748-ba59-e9db77bb66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.819128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70840c-4d0f-4748-ba59-e9db77bb66e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.819859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70840c-4d0f-4748-ba59-e9db77bb66e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.821489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70840c-4d0f-4748-ba59-e9db77bb66e5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.835827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1143/2356] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:50:07.839899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:07.852428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f82ab6-3807-466d-8755-4b8b4c9e0775 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:07.857501 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:07.858632 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.858983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.859260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] PATH_INFO: `/v3/projects/06b25872e76345898da2b4802d5033e9/users/352de82f4b1248acbc87f27fac39c59f/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.877906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b25872e76345898da2b4802d5033e9, user_id=352de82f4b1248acbc87f27fac39c59f, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:07.880636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:07.945062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1214/2357] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:50:07 2022] PUT /identity/v3/projects/06b25872e76345898da2b4802d5033e9/users/352de82f4b1248acbc87f27fac39c59f/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:50:07.959518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e9ef-9813-4f81-aa9e-c312ea1b76bb None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:07.959816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e9ef-9813-4f81-aa9e-c312ea1b76bb None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:07.960098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e9ef-9813-4f81-aa9e-c312ea1b76bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:07.988326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8b46e9ef-9813-4f81-aa9e-c312ea1b76bb None None] MFA Rules not processed for user `352de82f4b1248acbc87f27fac39c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:07.989538 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8b46e9ef-9813-4f81-aa9e-c312ea1b76bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:08.055334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1144/2358] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:08.066748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:08.068612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:08.078646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:08.127608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60487ba5-be74-4d5c-bf68-b93de288dd0f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:08.131330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:08.131981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:08.132265 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:08.132546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:08.140985 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:08.142455 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:08.151490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1215/2359] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:11.232623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418e82-9e7a-4272-a433-b41b6e528a63 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.233190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418e82-9e7a-4272-a433-b41b6e528a63 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.233310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418e82-9e7a-4272-a433-b41b6e528a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.252133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-29418e82-9e7a-4272-a433-b41b6e528a63 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:11.253357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-29418e82-9e7a-4272-a433-b41b6e528a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:11.320721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1145/2360] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:50:11.468518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:11.470654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:11.545750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af63c79-fd1e-4efc-ac82-7dcccc65a2ae service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:11.552524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:11.553189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:11.553475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:11.553754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:11.562661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:11.564318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:11.574818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1216/2361] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:16.663122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.663680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.663680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.681839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:16.683059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:16.691911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1146/2362] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:16.714225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:16.725801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d06c1-3fc9-4140-ac86-6307078576f6 service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:16.731688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe4f08-6ab3-4681-99bd-b09845978a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:16.732343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe4f08-6ab3-4681-99bd-b09845978a44 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:16.732625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe4f08-6ab3-4681-99bd-b09845978a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:16.732901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe4f08-6ab3-4681-99bd-b09845978a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:16.742179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe4f08-6ab3-4681-99bd-b09845978a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:16.743769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe4f08-6ab3-4681-99bd-b09845978a44 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:16.754337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1217/2363] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:19.697377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:19.704126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3257-4fb9-4e62-982c-b03a89f5c9d9 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:19.714055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:19.714981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:19.715267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:19.715543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] PATH_INFO: `/v3/users/352de82f4b1248acbc87f27fac39c59f` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:19.716839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=352de82f4b1248acbc87f27fac39c59f)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:19.718804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:19.912659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:19.920687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352de82f4b1248acbc87f27fac39c59f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:19.992527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352de82f4b1248acbc87f27fac39c59f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.006055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352de82f4b1248acbc87f27fac39c59f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.006716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352de82f4b1248acbc87f27fac39c59f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.013451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352de82f4b1248acbc87f27fac39c59f'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.019909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1147/2364] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:50:19 2022] DELETE /identity/v3/users/352de82f4b1248acbc87f27fac39c59f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:20.024671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:20.025272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:20.025272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:20.042246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:20.043559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:20.102276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1218/2365] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:50:20.112728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:20.114139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:20.174968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b6d2-1b69-4ce0-89e0-9497cf05e73c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:20.178596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313893-bc5d-406a-b9b0-32361e2e9d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:20.179268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313893-bc5d-406a-b9b0-32361e2e9d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:20.179570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313893-bc5d-406a-b9b0-32361e2e9d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:20.179827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313893-bc5d-406a-b9b0-32361e2e9d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:20.189957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92313893-bc5d-406a-b9b0-32361e2e9d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:20.197454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92313893-bc5d-406a-b9b0-32361e2e9d18 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:20.201479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1148/2366] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:50:20.588602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:20.590052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:20.604641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774eb2e-ade9-4f21-bea4-ca438d4dcd5d None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:20.609372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:20.614156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:20.614156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:20.614156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] PATH_INFO: `/v3/projects/06b25872e76345898da2b4802d5033e9` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:20.614156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b25872e76345898da2b4802d5033e9)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:20.614156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:20.631406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:20.741553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b25872e76345898da2b4802d5033e9', 'request_id': 'req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.747944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b25872e76345898da2b4802d5033e9', 'request_id': 'req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.826551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b25872e76345898da2b4802d5033e9', 'request_id': 'req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.840570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] The token cache is being invalidate because project 06b25872e76345898da2b4802d5033e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:50:20.840862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.841521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:50:20.843712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1219/2367] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:50:20 2022] DELETE /identity/v3/projects/06b25872e76345898da2b4802d5033e9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:50:22.067937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9808d-b676-4c9a-a1c7-2b80b7489609 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:22.068409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9808d-b676-4c9a-a1c7-2b80b7489609 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:22.068500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9808d-b676-4c9a-a1c7-2b80b7489609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:22.085713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-77b9808d-b676-4c9a-a1c7-2b80b7489609 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:22.086972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-77b9808d-b676-4c9a-a1c7-2b80b7489609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:22.146361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1149/2368] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:22.181525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:22.183015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:22.258309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c833-3f84-4f89-aa3e-4ac82f2963e9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:22.263803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f64d6-2aad-46bb-8392-0a0f86f8d901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:22.264449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f64d6-2aad-46bb-8392-0a0f86f8d901 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:22.264733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f64d6-2aad-46bb-8392-0a0f86f8d901 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:22.265011 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f64d6-2aad-46bb-8392-0a0f86f8d901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:22.273211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f64d6-2aad-46bb-8392-0a0f86f8d901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:22.274812 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f64d6-2aad-46bb-8392-0a0f86f8d901 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:22.284313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1220/2369] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:27.904090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:27.904588 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:27.904684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:27.923234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] MFA Rules not processed for user `12305af61a2941fe81075b7e6609c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:27.924464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:27.992874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1150/2370] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:28.010761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04e85-5e76-41d0-9ccf-de49c19a5304 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:28.011164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04e85-5e76-41d0-9ccf-de49c19a5304 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:28.011362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04e85-5e76-41d0-9ccf-de49c19a5304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:28.030038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-bcb04e85-5e76-41d0-9ccf-de49c19a5304 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:28.031467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bcb04e85-5e76-41d0-9ccf-de49c19a5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:28.039882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1221/2371] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:28.151199 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:28.158103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:28.164507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51808-0c82-4b32-990b-79285a920ee6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:28.170043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:28.170682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:28.172217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:28.172217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:28.180337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:28.181919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:28.191474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1151/2372] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:32.262417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b1f3-a5d5-444d-9f67-b7500b83fad5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:32.262955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b1f3-a5d5-444d-9f67-b7500b83fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:32.263151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b1f3-a5d5-444d-9f67-b7500b83fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:32.283012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-1a96b1f3-a5d5-444d-9f67-b7500b83fad5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:32.284316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1a96b1f3-a5d5-444d-9f67-b7500b83fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:32.293517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1222/2373] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:32.357206 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:32.369441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d45f2a-3ff1-45a1-8996-af6fafe99503 service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:32.374972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:32.375618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:32.375904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:32.376181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:32.385604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:32.387263 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:32.396973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1152/2374] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:37.568862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bb0e0-0a40-4934-bbe7-46958307cbb6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:37.569849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bb0e0-0a40-4934-bbe7-46958307cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:37.569994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bb0e0-0a40-4934-bbe7-46958307cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:37.588220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-9f5bb0e0-0a40-4934-bbe7-46958307cbb6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:37.589414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9f5bb0e0-0a40-4934-bbe7-46958307cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:37.597354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1223/2375] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:37.622521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:50:37.634205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f0aec-639f-47c7-9f8f-631d72058536 service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:50:37.639800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9619-d583-429a-bb0a-9d02c769b8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:50:37.640432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9619-d583-429a-bb0a-9d02c769b8d9 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:37.640719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9619-d583-429a-bb0a-9d02c769b8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:37.640995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9619-d583-429a-bb0a-9d02c769b8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:37.649283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a9619-d583-429a-bb0a-9d02c769b8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:50:37.663387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a9619-d583-429a-bb0a-9d02c769b8d9 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:50:37.663387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1153/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:50:46.953457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467f1c-0af8-4b07-a0c7-5a1f8fc3d978 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:46.954020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467f1c-0af8-4b07-a0c7-5a1f8fc3d978 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:46.954020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467f1c-0af8-4b07-a0c7-5a1f8fc3d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:46.972249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-21467f1c-0af8-4b07-a0c7-5a1f8fc3d978 None None] MFA Rules not processed for user `56083498939444d3b06f6282ed22d253`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:46.973466 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-21467f1c-0af8-4b07-a0c7-5a1f8fc3d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:47.034602 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1224/2377] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:47.656358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=17 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:54.090272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:54.090889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:54.090889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:54.108973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] MFA Rules not processed for user `d1282d4187a54299836bb6b4300d15c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:54.113638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:54.165762 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1154/2378] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:50:55.730576 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c28ce-af3d-4aa1-9996-5ff423bd4858 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:50:55.731125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c28ce-af3d-4aa1-9996-5ff423bd4858 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:50:55.731233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c28ce-af3d-4aa1-9996-5ff423bd4858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:50:55.737114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:55.749863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e19c28ce-af3d-4aa1-9996-5ff423bd4858 None None] MFA Rules not processed for user `7fabf88ca8954bc791ac01aebb221f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:50:55.751113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e19c28ce-af3d-4aa1-9996-5ff423bd4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:50:55.809190 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1225/2379] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:04.158603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=25 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:05.894629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=24 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:13.840930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:13.842398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:13.900011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe96f4-3fac-4094-9de7-4e66052761c5 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:13.903622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:13.904394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:13.904700 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:13.904981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:13.906807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:13.920302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:13.921728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:13.932750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1155/2380] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:15.514773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6799be-8a07-4495-8335-68d52a3c1377 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:15.515310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6799be-8a07-4495-8335-68d52a3c1377 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:15.515310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6799be-8a07-4495-8335-68d52a3c1377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:15.534212 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7a6799be-8a07-4495-8335-68d52a3c1377 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:15.535921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7a6799be-8a07-4495-8335-68d52a3c1377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:15.543845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1226/2381] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:51:15.563920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:15.574945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d102-c99c-41cc-a88b-df4e790fede6 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:15.581014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:15.581644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:15.581925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:15.582200 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:15.590335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:15.591925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:15.601846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1156/2382] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:23.264464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16d3fd-a95a-46eb-8d62-38c4183ed8fd None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:23.267146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16d3fd-a95a-46eb-8d62-38c4183ed8fd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:23.267146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16d3fd-a95a-46eb-8d62-38c4183ed8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:23.289638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-5d16d3fd-a95a-46eb-8d62-38c4183ed8fd None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:23.289638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5d16d3fd-a95a-46eb-8d62-38c4183ed8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:23.296554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1227/2383] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:23.346654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:23.357322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810125d6-acf7-4001-9195-6c42035ff70f service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:23.365153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:23.365819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:23.366166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:23.366512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:23.379650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:23.381339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:23.396164 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1157/2384] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:26.984222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:26.984713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:26.984807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:27.002828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:27.004023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:27.011845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1228/2385] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:27.041924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:27.053490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b93b07-a338-4437-a416-291aacf01b0c service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:27.059157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d50eb9-5034-4932-9468-858873c2c506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:27.059866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d50eb9-5034-4932-9468-858873c2c506 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:27.060755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d50eb9-5034-4932-9468-858873c2c506 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:27.061034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d50eb9-5034-4932-9468-858873c2c506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:27.069754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d50eb9-5034-4932-9468-858873c2c506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:27.071350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d50eb9-5034-4932-9468-858873c2c506 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:27.081721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1158/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:29.332041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:29.333486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:29.346028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a10f94-0cd2-4426-b4eb-e0963de935aa None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:29.349637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:29.350281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:29.350564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:29.350882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:29.352594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:29.363720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:29.365140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:29.380115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1229/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:31.272704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fff750-c906-49e6-a2af-670d98689472 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:31.273216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fff750-c906-49e6-a2af-670d98689472 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:31.273326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fff750-c906-49e6-a2af-670d98689472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:31.291329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b3fff750-c906-49e6-a2af-670d98689472 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:31.292539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b3fff750-c906-49e6-a2af-670d98689472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:31.301090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1159/2388] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:31.328963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:31.341509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d3b3b-f3b2-4d10-b8a1-199cd6ee35c6 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:31.348376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:31.349424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:31.349934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:31.350437 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:31.359727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:31.362112 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:31.371494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1230/2389] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:37.581026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:37.581429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:37.581686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:37.588499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=48 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:37.600959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:37.602153 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:37.611079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1160/2390] 10.222.0.20 () {58 vars in 1016 bytes} [Thu Jul 21 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:37.634053 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:37.639967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=22 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:37.646052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7309de3-e039-47f3-b078-8ef71523fa72 service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:37.651587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:37.652249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:37.652531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:37.652809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:37.661773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:37.664838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:37.673505 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1231/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:44.083898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:44.085340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:44.144377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca41d2f-dc10-40b8-8fe5-a9d5262327f6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:44.148037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:44.148650 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:44.148935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:44.149212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:44.151015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:44.163852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:44.165261 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:44.174850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1161/2392] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:47.682852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:47.893364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:47.906180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819392f-3241-4185-97ac-b0de8a8b435a service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:47.912228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:47.912972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:47.913350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:47.913638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:47.915552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:47.926854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:47.928517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:47.938271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1232/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:47.979831 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:47.981352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:48.067551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f59b-73ab-40de-9d09-fd608df776f4 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:48.073462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:48.074168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:48.075556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:48.075556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:48.077123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:48.088968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:48.090648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:48.106421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1162/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:48.107604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:48.109729 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:48.132171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10225c3-01b3-417b-8d07-3969e683497d service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:48.136850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:48.137727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:48.138013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:48.138295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] PATH_INFO: `/v3/users/12305af61a2941fe81075b7e6609c53e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:48.140203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12305af61a2941fe81075b7e6609c53e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:48.142159 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:48.335888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12305af61a2941fe81075b7e6609c53e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.401401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12305af61a2941fe81075b7e6609c53e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.403864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12305af61a2941fe81075b7e6609c53e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.409935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12305af61a2941fe81075b7e6609c53e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.421833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7df13722-fa13-4ea8-bcb2-be59bc58904a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12305af61a2941fe81075b7e6609c53e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.427876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1233/2395] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:51:48 2022] DELETE /identity/v3/users/12305af61a2941fe81075b7e6609c53e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:48.683391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:48.694676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14c62a-eb5a-4a27-90d6-5c499eb58b67 service placement] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:48.754592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:48.755577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:48.755869 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:48.756149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] PATH_INFO: `/v3/projects/d2e40cd799fc4057bc62d9f40df79884` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:48.757339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e40cd799fc4057bc62d9f40df79884)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:48.759300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:48.840668 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:48.853851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e40cd799fc4057bc62d9f40df79884', 'request_id': 'req-fb3378ad-b34d-4c53-9063-b2300117e8c0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.860655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e40cd799fc4057bc62d9f40df79884', 'request_id': 'req-fb3378ad-b34d-4c53-9063-b2300117e8c0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.940805 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e40cd799fc4057bc62d9f40df79884', 'request_id': 'req-fb3378ad-b34d-4c53-9063-b2300117e8c0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.950274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] The token cache is being invalidate because project d2e40cd799fc4057bc62d9f40df79884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:51:48.950564 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.951231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-fb3378ad-b34d-4c53-9063-b2300117e8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:48.953099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1163/2396] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:51:48 2022] DELETE /identity/v3/projects/d2e40cd799fc4057bc62d9f40df79884 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:48.957889 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234811-1713-4858-9471-332913318456 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:48.958348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234811-1713-4858-9471-332913318456 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:48.958640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234811-1713-4858-9471-332913318456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:48.980060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d3234811-1713-4858-9471-332913318456 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:48.981291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d3234811-1713-4858-9471-332913318456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:49.042980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1234/2397] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:49.051295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.051779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.051891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.070639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:49.071875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:49.079930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1164/2398] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:49.084559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234811-1713-4858-9471-332913318456 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.095372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234811-1713-4858-9471-332913318456 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.100276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.106379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.106379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.106379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.106379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:51:49.106379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.106379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.116851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1235/2399] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:51:49.121186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.130813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48748b94-6d56-422b-8924-a0043ee7850f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.135539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.138755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.138755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.138755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.138755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.139521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.239596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1165/2400] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:51:49 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:51:49.243522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.254132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40fcde-3627-4985-b37d-9868bc42b12e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.299753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:49.312831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.313531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.313787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.314056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.314849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.316761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.416441 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1236/2401] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:51:49 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:49.417829 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.429255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f2f5-9282-4216-85c9-224ac17220e0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.438461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.439251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.439535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.439819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.440633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.442198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.454821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1166/2402] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:51:49.458916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.469986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999934ae-fc1c-4754-88e5-386c7b19146f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.474790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5a1af-52d5-4835-9a12-85a28c7ada69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.475453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a1af-52d5-4835-9a12-85a28c7ada69 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.481712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a1af-52d5-4835-9a12-85a28c7ada69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.481712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a1af-52d5-4835-9a12-85a28c7ada69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.481712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5a1af-52d5-4835-9a12-85a28c7ada69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.481712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5a1af-52d5-4835-9a12-85a28c7ada69 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.489892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1237/2403] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:51:49.494104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.504405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aac81-f20f-4a72-b905-5f91d350c57f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.509026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.510430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.510430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.510703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] PATH_INFO: `/v3/projects/f14def1db00349368d6484360724d297/users/98f2d761a5484efe938266e08c65efc7/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.526353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14def1db00349368d6484360724d297, user_id=98f2d761a5484efe938266e08c65efc7, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.532411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.593378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1167/2404] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:51:49 2022] PUT /identity/v3/projects/f14def1db00349368d6484360724d297/users/98f2d761a5484efe938266e08c65efc7/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:49.606820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.607115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.607396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.636542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] MFA Rules not processed for user `98f2d761a5484efe938266e08c65efc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:49.637790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:49.706233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1238/2405] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:49.711122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.775301 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b191f7-3a4e-41c3-b7f1-3b3be688943f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.781004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.782120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.782410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.782748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.784112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.786681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:49.890028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1168/2406] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:51:49 2022] POST /identity/v3/projects => generated 403 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:49.893489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:49.908824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3826e-3cdc-49d2-8e1a-236233ba63d6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:49.968677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:49.969361 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:49.969648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:49.969953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:49.971043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:49.973003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.030836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1239/2407] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:51:49 2022] POST /identity/v3/users => generated 308 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:50.035243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:50.047086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdd7b-6a48-42b3-b7b9-919f3bf52953 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:50.051741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:50.052407 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.052688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.052960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.053690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:50.055322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.067715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1169/2408] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:51:50.072285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:50.083286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df5d5-521e-45fa-9219-91045a1bb78a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:50.089521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:50.090414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.090710 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.091006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] PATH_INFO: `/v3/projects/a1288c7ac2b94631a73df646419f1bd4/users/8075f58d19994664a23119e206079c33/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.108371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1288c7ac2b94631a73df646419f1bd4, user_id=8075f58d19994664a23119e206079c33, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:50.111294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.157542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1240/2409] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:51:50 2022] PUT /identity/v3/projects/a1288c7ac2b94631a73df646419f1bd4/users/8075f58d19994664a23119e206079c33/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:50.161691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:50.174056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b22a-a419-4c5f-9917-1b671a50c9f5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:50.201914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:50.235434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97c46-294d-4966-b4cf-80457772e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:50.236306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97c46-294d-4966-b4cf-80457772e12f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.236510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97c46-294d-4966-b4cf-80457772e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.236691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97c46-294d-4966-b4cf-80457772e12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.238071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97c46-294d-4966-b4cf-80457772e12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:50.238980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97c46-294d-4966-b4cf-80457772e12f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.250735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1170/2410] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:51:50.255958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:50.269143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220ae25-e21d-44ed-8f5f-1995b036fbe4 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:50.274069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:50.275052 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.275338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.275617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] PATH_INFO: `/v3/projects/a1288c7ac2b94631a73df646419f1bd4/users/8075f58d19994664a23119e206079c33/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.277608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1288c7ac2b94631a73df646419f1bd4, user_id=8075f58d19994664a23119e206079c33, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:50.280432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.292562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1241/2411] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:51:50 2022] PUT /identity/v3/projects/a1288c7ac2b94631a73df646419f1bd4/users/8075f58d19994664a23119e206079c33/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:50.304181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.304473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.304747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.331202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] MFA Rules not processed for user `8075f58d19994664a23119e206079c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:50.332429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:50.401340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1171/2412] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:50.412568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:50.414292 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:50.424697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:50.472538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96214d-2d3d-423d-8edd-dfd0fbae94b5 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:50.476393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08579d2-ae82-49ed-b942-5100d2ed771d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:50.477044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08579d2-ae82-49ed-b942-5100d2ed771d service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.477606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08579d2-ae82-49ed-b942-5100d2ed771d service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.477883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08579d2-ae82-49ed-b942-5100d2ed771d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.489607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08579d2-ae82-49ed-b942-5100d2ed771d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:50.491090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08579d2-ae82-49ed-b942-5100d2ed771d service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.500685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1242/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:50.651055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:50.715020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e37583-61e5-4127-b025-a88e03814a1c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:50.720063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:50.720935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.721224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.721501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] PATH_INFO: `/v3/users/98f2d761a5484efe938266e08c65efc7` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.722732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f2d761a5484efe938266e08c65efc7)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:50.724665 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:50.895654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f2d761a5484efe938266e08c65efc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:50.899505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:50.944331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f2d761a5484efe938266e08c65efc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:50.957885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f2d761a5484efe938266e08c65efc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:50.958572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f2d761a5484efe938266e08c65efc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:50.965461 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f2d761a5484efe938266e08c65efc7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:50.973268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1172/2414] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:51:50 2022] DELETE /identity/v3/users/98f2d761a5484efe938266e08c65efc7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:50.978080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:50.980699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:50.980699 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:50.995242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:50.998013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:51.056891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1243/2415] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:51.067329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:51.068814 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:51.126975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7e02-4f32-44dc-900c-1d38d818f942 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:51.130627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:51.131302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:51.131587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:51.131864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:51.140958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:51.142378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:51.151884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1173/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:51.558311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:51.559644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:51.572327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9452d-9108-474c-8f59-104ce0efa3fa None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:51.577754 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:51.578642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:51.578961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:51.579236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] PATH_INFO: `/v3/projects/f14def1db00349368d6484360724d297` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:51.580671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14def1db00349368d6484360724d297)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:51.582751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:51.713271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14def1db00349368d6484360724d297', 'request_id': 'req-4fcb78dd-d213-484c-a853-24630249ec3b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:51.720116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14def1db00349368d6484360724d297', 'request_id': 'req-4fcb78dd-d213-484c-a853-24630249ec3b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:51.818345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14def1db00349368d6484360724d297', 'request_id': 'req-4fcb78dd-d213-484c-a853-24630249ec3b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:51.833515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] The token cache is being invalidate because project f14def1db00349368d6484360724d297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:51:51.833805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:51.834443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:51.836064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1244/2417] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:51:51 2022] DELETE /identity/v3/projects/f14def1db00349368d6484360724d297 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:51.840067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:51.850953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad58045-186b-49c2-a7a2-27908dc4f6cd service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:51.909179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:51.910054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:51.910361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:51.910629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] PATH_INFO: `/v3/users/8075f58d19994664a23119e206079c33` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:51.911882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8075f58d19994664a23119e206079c33)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:51.913810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:52.095785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8075f58d19994664a23119e206079c33'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.149659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8075f58d19994664a23119e206079c33'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.162843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8075f58d19994664a23119e206079c33'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.163531 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8075f58d19994664a23119e206079c33'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.165727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:52.171322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-16fb823d-0fb1-4599-a87a-34f41eb0def0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8075f58d19994664a23119e206079c33'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.177882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1174/2418] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:51:51 2022] DELETE /identity/v3/users/8075f58d19994664a23119e206079c33 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:52.573713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:52.575594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:52.588964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb78dd-d213-484c-a853-24630249ec3b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:52.623983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:52.651471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:52.652362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:52.652649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:52.652932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] PATH_INFO: `/v3/projects/a1288c7ac2b94631a73df646419f1bd4` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:52.654949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1288c7ac2b94631a73df646419f1bd4)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:52.656916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:52.756774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1288c7ac2b94631a73df646419f1bd4', 'request_id': 'req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.765450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1288c7ac2b94631a73df646419f1bd4', 'request_id': 'req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.847124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1288c7ac2b94631a73df646419f1bd4', 'request_id': 'req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.858745 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] The token cache is being invalidate because project a1288c7ac2b94631a73df646419f1bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:51:52.859037 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.859662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4651453a-69f2-4c6b-9f20-d4bbbdb5afc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:51:52.861204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1245/2419] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:51:52 2022] DELETE /identity/v3/projects/a1288c7ac2b94631a73df646419f1bd4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:52.866087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:52.866382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:52.866666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:52.887056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:52.888286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:52.951850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1175/2420] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:52.959625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:52.959996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:52.960283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:52.979825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:52.981144 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:52.989335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1246/2421] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:52.998849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.010886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a355e-ce76-40f1-8ea0-c652c1ef6097 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.016560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.017291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.017579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.017867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.018611 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:51:53.018959 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.020581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.033697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1176/2422] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:51:53.038487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.048346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d352b4-e84a-4f33-8fd8-1baec9811ee0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.053012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.059756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.059756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.059756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.059756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.059756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.128305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1247/2423] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:51:53 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:53.137045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.148009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7179-eb94-4583-82d1-e3170df185e6 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.204666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.205379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.205662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.205938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.206641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.208582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.280933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1177/2424] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:51:53 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:53.285068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.296130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2af00-f368-45b0-aa24-abb19a07f08f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.302553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.303289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.303579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.303861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.304611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.306215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.317966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1248/2425] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:51:53.322050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.332690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734a45-d646-4a56-919f-08e61622a80b admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.337592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.338255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.338543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.338859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.339597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.341217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.352091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1178/2426] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:51:53.355787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.366617 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a02b-96c3-4129-a8a6-3382255c5883 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.371405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8af2d-80c1-4003-bc87-819b536fe23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.372320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8af2d-80c1-4003-bc87-819b536fe23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.373249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8af2d-80c1-4003-bc87-819b536fe23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.373538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8af2d-80c1-4003-bc87-819b536fe23d admin admin] PATH_INFO: `/v3/projects/5281ea5abf5a45fc80c11dfa62c19c5d/users/d2b97ea5459b44989c30172081b9d06b/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.388871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8af2d-80c1-4003-bc87-819b536fe23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5281ea5abf5a45fc80c11dfa62c19c5d, user_id=d2b97ea5459b44989c30172081b9d06b, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.391522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8af2d-80c1-4003-bc87-819b536fe23d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.443952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.445750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:53.453206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1249/2427] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:51:53 2022] PUT /identity/v3/projects/5281ea5abf5a45fc80c11dfa62c19c5d/users/d2b97ea5459b44989c30172081b9d06b/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:53.465650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.466967 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.467558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.504888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] MFA Rules not processed for user `d2b97ea5459b44989c30172081b9d06b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:53.506127 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:53.519742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:53.539093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0df3-8b73-49d2-b7d8-b4bf74fb84cf admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.557078 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:53.575111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1250/2428] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:53.581149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.611727 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.612394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.612675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.612948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.616358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:53.652024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73321e7-593d-4991-8d8d-962e4a6bc06b None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.658676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.660076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.660076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.660261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.660981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.663150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.679941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.681523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.691671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1179/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:53.757571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1251/2430] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:51:53 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:53.761725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.772940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa8aa-2244-4f5b-b94f-ce4783203bbf service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.835837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.836619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.836799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.837060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.837758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.845816 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.947135 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1180/2431] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:51:53 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:51:53.948285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.959738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175303-afe0-4e34-9f43-71213b73113a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:53.964368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:53.965184 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:53.965409 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:53.965680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:53.967246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:53.968843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:53.980817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1252/2432] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:51:53.985158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:53.995264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bcbea-79f6-4dd7-a647-c45c26bad65c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:54.001203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:54.001203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:54.001449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:54.001550 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] PATH_INFO: `/v3/projects/a0b7bae80f6548d7967342dbf79f0e4c/users/ae476c448245457da0dd637444da0916/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:54.016890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7bae80f6548d7967342dbf79f0e4c, user_id=ae476c448245457da0dd637444da0916, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:54.019582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:54.087626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:54.094771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1181/2433] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:51:53 2022] PUT /identity/v3/projects/a0b7bae80f6548d7967342dbf79f0e4c/users/ae476c448245457da0dd637444da0916/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:51:54.099071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:54.118349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114de4-c6ca-4db3-8e8e-4118a15d37bd admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:54.177316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626c05e-d881-486b-bfbc-37994bc9b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:54.177916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626c05e-d881-486b-bfbc-37994bc9b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:54.178202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626c05e-d881-486b-bfbc-37994bc9b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:54.178479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626c05e-d881-486b-bfbc-37994bc9b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:54.179247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626c05e-d881-486b-bfbc-37994bc9b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:54.180838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626c05e-d881-486b-bfbc-37994bc9b3b7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:54.198279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1253/2434] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:51:54.198664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:54.211536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf61c2-f7fc-47b4-bc41-5b151fa06080 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:54.216835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:54.218046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:54.218426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:54.218809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] PATH_INFO: `/v3/projects/a0b7bae80f6548d7967342dbf79f0e4c/users/ae476c448245457da0dd637444da0916/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:54.220857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7bae80f6548d7967342dbf79f0e4c, user_id=ae476c448245457da0dd637444da0916, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:54.223544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:54.234953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1182/2435] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:51:54 2022] PUT /identity/v3/projects/a0b7bae80f6548d7967342dbf79f0e4c/users/ae476c448245457da0dd637444da0916/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:51:54.245866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:54.246152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:54.246434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:54.274107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] MFA Rules not processed for user `ae476c448245457da0dd637444da0916`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:51:54.275367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:54.321464 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:54.349748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1254/2436] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:51:54.394857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:54.402295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:51:54.470095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549f66-e924-4017-921c-732d4c951353 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:54.474372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:54.475046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:54.477444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:54.477444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:54.535776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:54.537349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:54.547774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1183/2437] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:51:57.769958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:51:57.788568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e223fa-bc14-46ea-b572-87337168fb9f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:51:57.790276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed0713-adfa-4573-a902-40c8a1d4d3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:51:57.790982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0713-adfa-4573-a902-40c8a1d4d3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:51:57.791690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0713-adfa-4573-a902-40c8a1d4d3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:51:57.791690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0713-adfa-4573-a902-40c8a1d4d3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:51:57.801578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed0713-adfa-4573-a902-40c8a1d4d3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:51:57.803170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed0713-adfa-4573-a902-40c8a1d4d3c9 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:51:57.813888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1255/2438] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:51:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:03.612073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:03.760098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989074c-c48a-42ae-b040-31ca5391236b service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:03.767828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:03.768478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:03.774304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:03.774304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:03.774304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:03.787314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:03.788751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:03.803274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1184/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:07.808772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=13 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:07.899336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:07.899631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:07.899911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:07.918377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] MFA Rules not processed for user `d1282d4187a54299836bb6b4300d15c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:07.919697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:07.976225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1256/2440] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:08.276960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:08.278504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:08.307423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:08.352776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b076fea-b49f-4d15-a05e-b1e5292c9eed service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:08.352776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:08.352776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:08.352776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:08.353205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:08.353205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:08.358128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:08.359576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:08.367359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1185/2441] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:08.761286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:08.762838 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:08.835363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a078e1-46f6-4089-82dc-d3247bddeea3 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:08.841150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:08.841845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:08.842154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:08.842432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:08.844334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:08.856870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:08.858396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:08.872338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1257/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:12.143098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:12.151777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78337e-00e5-4850-ba03-6a2c6a419d33 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:12.155534 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:12.156177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:12.156466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:12.156744 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:12.158715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:12.169458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:12.170921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8706a71-1969-4207-9781-d462f821d77e service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:12.179514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1186/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:12.719235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:12.816834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57362-feb0-4abb-b828-30d193b910b8 service placement] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:12.822305 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:12.823456 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:12.823830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:12.824217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] PATH_INFO: `/v3/users/d2b97ea5459b44989c30172081b9d06b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:12.825544 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b97ea5459b44989c30172081b9d06b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:12.827609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:13.056620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:13.066221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b97ea5459b44989c30172081b9d06b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:13.164568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b97ea5459b44989c30172081b9d06b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:13.165261 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b97ea5459b44989c30172081b9d06b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:13.173657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b97ea5459b44989c30172081b9d06b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:13.187351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b97ea5459b44989c30172081b9d06b'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:13.193493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1258/2444] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:12 2022] DELETE /identity/v3/users/d2b97ea5459b44989c30172081b9d06b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:13.198152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:13.198671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:13.198872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:13.220503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:13.221408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:13.284712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1187/2445] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:13.295222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:13.297352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:13.356454 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095fb6-7d40-477c-a7e5-0a4c80df45f6 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:13.360598 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:13.361304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:13.361589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:13.361867 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:13.372145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:13.373594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:13.384038 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1259/2446] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:14.030130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:14.031639 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:14.051054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28782-f89e-47db-8bfa-7f7b6e13b1a1 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:14.058240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:14.059607 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:14.059950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:14.060567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] PATH_INFO: `/v3/projects/5281ea5abf5a45fc80c11dfa62c19c5d` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:14.062075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5281ea5abf5a45fc80c11dfa62c19c5d)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:14.065035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:14.181212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5281ea5abf5a45fc80c11dfa62c19c5d', 'request_id': 'req-c7c60700-c77e-43f4-99f9-8b7422e76390'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.190029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5281ea5abf5a45fc80c11dfa62c19c5d', 'request_id': 'req-c7c60700-c77e-43f4-99f9-8b7422e76390'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.301390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5281ea5abf5a45fc80c11dfa62c19c5d', 'request_id': 'req-c7c60700-c77e-43f4-99f9-8b7422e76390'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.315573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] The token cache is being invalidate because project 5281ea5abf5a45fc80c11dfa62c19c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:14.316298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.317277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.325594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1188/2447] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:14 2022] DELETE /identity/v3/projects/5281ea5abf5a45fc80c11dfa62c19c5d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:14.325850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:14.335606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f00f6-7202-4e8c-b887-03c00f7df594 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:14.402272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:14.407094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:14.407859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:14.408099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] PATH_INFO: `/v3/users/ae476c448245457da0dd637444da0916` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:14.409432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae476c448245457da0dd637444da0916)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:14.414074 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:14.688440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae476c448245457da0dd637444da0916'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.759651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae476c448245457da0dd637444da0916'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.760418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae476c448245457da0dd637444da0916'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.766435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:14.769352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae476c448245457da0dd637444da0916'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.786249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae476c448245457da0dd637444da0916'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:14.793703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1260/2448] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:14 2022] DELETE /identity/v3/users/ae476c448245457da0dd637444da0916 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:52:14.848619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:14.850897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:14.867576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60700-c77e-43f4-99f9-8b7422e76390 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:14.920181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:14.946103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:14.947292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:14.947292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:14.947682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] PATH_INFO: `/v3/users/7fabf88ca8954bc791ac01aebb221f8b` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:14.949676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fabf88ca8954bc791ac01aebb221f8b)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:14.951684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:15.165985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fabf88ca8954bc791ac01aebb221f8b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.284571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fabf88ca8954bc791ac01aebb221f8b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.292883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:15.298006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:15.311626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0aaded-921b-4508-a6dc-a77d687f63ca admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:15.312605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fabf88ca8954bc791ac01aebb221f8b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.314151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fabf88ca8954bc791ac01aebb221f8b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.317879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:15.318963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.319251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.319522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] PATH_INFO: `/v3/projects/a0b7bae80f6548d7967342dbf79f0e4c` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.320841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b7bae80f6548d7967342dbf79f0e4c)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:15.322658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5cf8e7fb-839a-4502-b7d1-3d3612dbe769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fabf88ca8954bc791ac01aebb221f8b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.322839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:15.337339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1189/2449] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:14 2022] DELETE /identity/v3/users/7fabf88ca8954bc791ac01aebb221f8b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:15.503687 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b7bae80f6548d7967342dbf79f0e4c', 'request_id': 'req-401509ff-874f-43c1-9110-ef8d42388ba8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.513068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b7bae80f6548d7967342dbf79f0e4c', 'request_id': 'req-401509ff-874f-43c1-9110-ef8d42388ba8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.576233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b7bae80f6548d7967342dbf79f0e4c', 'request_id': 'req-401509ff-874f-43c1-9110-ef8d42388ba8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.588248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] The token cache is being invalidate because project a0b7bae80f6548d7967342dbf79f0e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:15.588534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.589677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-401509ff-874f-43c1-9110-ef8d42388ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.591727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1261/2450] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:15 2022] DELETE /identity/v3/projects/a0b7bae80f6548d7967342dbf79f0e4c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:52:15.597100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.597383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.597654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.616910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:15.618162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:15.680640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1190/2451] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:15.692850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51144d8-99c5-4162-b683-0c90c613914a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.692850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51144d8-99c5-4162-b683-0c90c613914a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.692850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51144d8-99c5-4162-b683-0c90c613914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.697912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:15.701536 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:15.717614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f51144d8-99c5-4162-b683-0c90c613914a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:15.719026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f51144d8-99c5-4162-b683-0c90c613914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:15.722504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0625a7a-7c9f-464e-aa55-7db4df50a27c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:15.728024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:15.728388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1262/2452] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:15.729721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.730555 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.732797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.733231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.733497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] PATH_INFO: `/v3/projects/41558c8833b44fe8ace40ccf418bc94e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.733859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.734927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41558c8833b44fe8ace40ccf418bc94e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:15.736882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:15.752635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:15.753848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:15.812403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1263/2453] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:15.813271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:15.825813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce99068-47ef-4622-bd93-c2d7ff5c58f0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:15.831707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:15.832383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.832760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.833041 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.834287 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:52:15.834621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:15.836512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:15.853785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1264/2454] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:52:15.855452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:15.861915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41558c8833b44fe8ace40ccf418bc94e', 'request_id': 'req-2fa2da5d-a462-4085-8f3b-000a401b90e0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.868153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be844-3405-464c-bbad-4b4a3fc3715e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:15.870080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41558c8833b44fe8ace40ccf418bc94e', 'request_id': 'req-2fa2da5d-a462-4085-8f3b-000a401b90e0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.922813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:15.923473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:15.923757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:15.924029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:15.924712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:15.926603 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:15.941770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41558c8833b44fe8ace40ccf418bc94e', 'request_id': 'req-2fa2da5d-a462-4085-8f3b-000a401b90e0'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.953363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:15.954602 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] The token cache is being invalidate because project 41558c8833b44fe8ace40ccf418bc94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:15.954917 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.955621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:15.957382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1191/2455] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:15 2022] DELETE /identity/v3/projects/41558c8833b44fe8ace40ccf418bc94e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:52:15.958148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:15.959454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:16.040363 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2da5d-a462-4085-8f3b-000a401b90e0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.045963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:16.046640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.046967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.047231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.049287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:16.056156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1265/2456] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:15 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:16.057262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:16.060024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:16.132985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:16.136673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:16.139251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:16.142135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9db5-cabb-4927-a7a2-810a9c858305 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.147172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:16.147879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.148162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.148444 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.149154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:16.152351 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:16.159787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1192/2457] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:16.283009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1266/2458] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:16 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:16.287692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:16.310323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80ea7-1671-42be-bcbe-4fda24bb18a4 service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.315706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:16.316455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.316806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.317151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.318071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:16.321408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:16.337677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1193/2459] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:16.341845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:16.358682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1ebf-9ab1-4da6-84f4-2d25ae304c87 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.365678 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7dec3-1491-4df4-9b3b-ca948941ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:16.366371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7dec3-1491-4df4-9b3b-ca948941ffdb admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.366876 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7dec3-1491-4df4-9b3b-ca948941ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.367342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7dec3-1491-4df4-9b3b-ca948941ffdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.368375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7dec3-1491-4df4-9b3b-ca948941ffdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:16.370779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7dec3-1491-4df4-9b3b-ca948941ffdb admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:16.381908 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1267/2460] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:16.387125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:16.398003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c11d9-479a-4ac5-8c3b-1d5ead0519c8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.404302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:16.405444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.406220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.406720 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] PATH_INFO: `/v3/projects/6f64783bdfe240979401eb2ea503c410/users/af53ff6e63c245b89232e1edd104f308/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.431780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f64783bdfe240979401eb2ea503c410, user_id=af53ff6e63c245b89232e1edd104f308, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:16.439595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:16.524332 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1194/2461] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:16 2022] PUT /identity/v3/projects/6f64783bdfe240979401eb2ea503c410/users/af53ff6e63c245b89232e1edd104f308/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:16.536158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.536715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.536715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.567365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] MFA Rules not processed for user `af53ff6e63c245b89232e1edd104f308`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:16.570412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:16.652727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1268/2462] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:16.654022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:16.708749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:16.758252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a4e0e-de4d-42ae-965b-33d83ec1af75 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.765976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:16.767042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:16.767542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:16.768042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:16.768898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:16.773304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:16.890726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1195/2463] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:16 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:16.893530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:16.913689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed860f-1e49-4de1-af2e-d6a096cbe04e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:16.969046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:17.004083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.004910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.005198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.005472 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.006794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:17.008785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:17.076344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:17.078304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:17.118768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1269/2464] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:16 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:17.122903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:17.143302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5d8e0-2faf-4e5b-9b57-562b7e1426ea admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:17.155189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.155982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.156380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.156859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.157644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:17.159395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:17.191712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588e8ce-b987-4e5b-b317-5c5faff12c04 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:17.210742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1270/2465] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:52:17.210937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.210937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.210937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.210937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.211247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:17.211334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:17.225196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:17.227694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3fe5-553f-49f6-83e8-fe2204698624 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:17.227940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:17.242510 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8bca-bdbc-4b9a-96ca-f5fbfdcbe9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.243846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8bca-bdbc-4b9a-96ca-f5fbfdcbe9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.244326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1196/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:17.254750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8bca-bdbc-4b9a-96ca-f5fbfdcbe9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.257819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8bca-bdbc-4b9a-96ca-f5fbfdcbe9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.258898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c8bca-bdbc-4b9a-96ca-f5fbfdcbe9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:17.263841 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c8bca-bdbc-4b9a-96ca-f5fbfdcbe9ed admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:17.288829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1271/2467] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:52:17.292770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:17.307130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8323c-5a7b-4606-8de7-f55bf8a525aa service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:17.314280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.342165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.342165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.342165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] PATH_INFO: `/v3/projects/2dd0949a45da472bb38f8c68d330ab91/users/530728f2e1f446ce8983cdcaa06bde00/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.342165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd0949a45da472bb38f8c68d330ab91, user_id=530728f2e1f446ce8983cdcaa06bde00, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:17.344815 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:17.554292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1197/2468] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:17 2022] PUT /identity/v3/projects/2dd0949a45da472bb38f8c68d330ab91/users/530728f2e1f446ce8983cdcaa06bde00/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:17.568247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.568930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.569210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.612449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] MFA Rules not processed for user `530728f2e1f446ce8983cdcaa06bde00`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:17.613975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:17.730179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1272/2469] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:52:17.734961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:17.818850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2ff76-c9da-450e-8bb2-d24f6012580b admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:17.824296 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.825000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.825254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.825530 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:17.826237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:17.828247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:17.899519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1198/2470] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:17 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:17.904528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:17.916620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c47d-4ba4-4cbb-a87c-2cb4946762ca None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:17.998727 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:17.999328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:17.999613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:17.999944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.000659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:18.003663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:18.105260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1273/2471] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:17 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:18.109178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:18.131817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64906-ad87-40c2-9ffb-5b5271ad652f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:18.139064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:18.139881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:18.140282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:18.140669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.141514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:18.143344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:18.158729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1199/2472] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:18.160220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:18.171157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aff78a-f9c4-426b-a107-a51432d0d85a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:18.176460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:18.183297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:18.183297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:18.183297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] PATH_INFO: `/v3/projects/bb1ce49cbfcb4e2b83dd546d3ebb2743/users/9e17665593414393a5bdea534dd20717/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.196046 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1ce49cbfcb4e2b83dd546d3ebb2743, user_id=9e17665593414393a5bdea534dd20717, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:18.200395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:18.263452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:18.270833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1274/2473] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:18 2022] PUT /identity/v3/projects/bb1ce49cbfcb4e2b83dd546d3ebb2743/users/9e17665593414393a5bdea534dd20717/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:18.277134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:18.285942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb635d1f-cb58-4e91-b00b-d3473a562b41 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:18.290378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:18.354340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc27922-75c9-4f97-821f-09c81836705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:18.355881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc27922-75c9-4f97-821f-09c81836705c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:18.356265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc27922-75c9-4f97-821f-09c81836705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:18.356544 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc27922-75c9-4f97-821f-09c81836705c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.357328 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc27922-75c9-4f97-821f-09c81836705c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:18.358984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc27922-75c9-4f97-821f-09c81836705c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:18.371208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1200/2474] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:18.387658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:18.387658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baffeea-af7d-4b95-ba5b-ae3eaa433a5f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:18.392253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:18.393336 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:18.393804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:18.394248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] PATH_INFO: `/v3/projects/bb1ce49cbfcb4e2b83dd546d3ebb2743/users/9e17665593414393a5bdea534dd20717/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.396497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1ce49cbfcb4e2b83dd546d3ebb2743, user_id=9e17665593414393a5bdea534dd20717, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:18.399493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:18.420805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1275/2475] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:18 2022] PUT /identity/v3/projects/bb1ce49cbfcb4e2b83dd546d3ebb2743/users/9e17665593414393a5bdea534dd20717/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:18.427656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:18.427656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:18.427656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.454583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] MFA Rules not processed for user `9e17665593414393a5bdea534dd20717`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:18.456295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:18.537189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1201/2476] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:18.548988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:18.551352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:18.622655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562439e8-3580-44d0-8410-75a4eebfe877 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:18.626762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de833f1e-75ce-44f6-9fde-3d709fc051e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:18.627425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de833f1e-75ce-44f6-9fde-3d709fc051e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:18.627714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de833f1e-75ce-44f6-9fde-3d709fc051e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:18.627992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de833f1e-75ce-44f6-9fde-3d709fc051e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:18.643375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de833f1e-75ce-44f6-9fde-3d709fc051e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:18.644829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de833f1e-75ce-44f6-9fde-3d709fc051e8 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:18.668629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1276/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:20.436483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:20.439779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:20.453431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964435-cd45-45fa-aea6-6e7f885891f8 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:20.459526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c677cb-ae17-452c-aff2-de35ca64a3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:20.460325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c677cb-ae17-452c-aff2-de35ca64a3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:20.460610 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c677cb-ae17-452c-aff2-de35ca64a3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:20.460883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c677cb-ae17-452c-aff2-de35ca64a3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:20.554071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c677cb-ae17-452c-aff2-de35ca64a3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:20.555750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c677cb-ae17-452c-aff2-de35ca64a3b6 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:20.571416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1202/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:24.595476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f644-aee2-4f9b-a0d1-b9289c0e2037 None None] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:24.596164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f644-aee2-4f9b-a0d1-b9289c0e2037 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:24.596164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f644-aee2-4f9b-a0d1-b9289c0e2037 None None] PATH_INFO: `/` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:24.598777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1277/2479] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:52:24.607082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b340e40-001f-46d2-9b27-905f5604170c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:24.607627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b340e40-001f-46d2-9b27-905f5604170c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:24.607738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b340e40-001f-46d2-9b27-905f5604170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:24.638881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-0b340e40-001f-46d2-9b27-905f5604170c None None] MFA Rules not processed for user `827c5b6ddf0b4e899dd0c2ab3e05b0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:24.640196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0b340e40-001f-46d2-9b27-905f5604170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:24.670017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:24.706279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1203/2480] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:24.721579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8f644-aee2-4f9b-a0d1-b9289c0e2037 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:24.724462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1fa8f644-aee2-4f9b-a0d1-b9289c0e2037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:24.745990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8f644-aee2-4f9b-a0d1-b9289c0e2037 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:24.762278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565b3b0-5c81-4555-864f-04f99120cbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:24.763137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565b3b0-5c81-4555-864f-04f99120cbdb service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:24.763428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565b3b0-5c81-4555-864f-04f99120cbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:24.763756 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565b3b0-5c81-4555-864f-04f99120cbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:24.784659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565b3b0-5c81-4555-864f-04f99120cbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:24.786224 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565b3b0-5c81-4555-864f-04f99120cbdb service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:24.798772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1278/2481] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:24.902784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f287f-6be6-4b09-abe7-9e0a5eed0d0e None None] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:24.903750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f287f-6be6-4b09-abe7-9e0a5eed0d0e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:24.904123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f287f-6be6-4b09-abe7-9e0a5eed0d0e None None] PATH_INFO: `/` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:24.905944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1204/2482] 10.222.0.49 () {54 vars in 921 bytes} [Thu Jul 21 10:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 10:52:24.932439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:24.932439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:24.932439 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:24.956839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] MFA Rules not processed for user `0be525488dbf496cb0440dc4b046df85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:24.958358 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:25.097082 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1279/2483] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Jul 21 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:52:25.104001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f287f-6be6-4b09-abe7-9e0a5eed0d0e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:25.106327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b63f287f-6be6-4b09-abe7-9e0a5eed0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:25.127282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f287f-6be6-4b09-abe7-9e0a5eed0d0e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:25.131629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:25.133876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:25.133876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:25.133876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:25.145262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:25.147337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:25.193788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1205/2484] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:26.500304 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:26.514377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d6644-6c8d-42f2-832b-805dd9fd5666 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:26.520089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:26.520757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:26.521040 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:26.521371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:26.523204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:26.537744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:26.539378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:26.551836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1280/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:28.257907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:28.267795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007b2e-16e3-4aef-aa33-7d68f1bf61d7 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:28.271453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4688d6-7e61-4329-91e8-8365f4f6a3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:28.272089 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4688d6-7e61-4329-91e8-8365f4f6a3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:28.272373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4688d6-7e61-4329-91e8-8365f4f6a3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:28.277712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4688d6-7e61-4329-91e8-8365f4f6a3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:28.328848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4688d6-7e61-4329-91e8-8365f4f6a3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:28.330286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4688d6-7e61-4329-91e8-8365f4f6a3a7 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:28.339608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1206/2486] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:32.363335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:32.421707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:32.427075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87b08-e55f-4f73-9a27-6d8e7999c05f service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:32.432535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:32.439330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:32.439330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:32.439330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] PATH_INFO: `/v3/users/af53ff6e63c245b89232e1edd104f308` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:32.439330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af53ff6e63c245b89232e1edd104f308)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:32.439330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:32.644775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af53ff6e63c245b89232e1edd104f308'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:32.711350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af53ff6e63c245b89232e1edd104f308'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:32.712495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af53ff6e63c245b89232e1edd104f308'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:32.721007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af53ff6e63c245b89232e1edd104f308'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:32.734923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af53ff6e63c245b89232e1edd104f308'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:32.741765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1281/2487] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:32 2022] DELETE /identity/v3/users/af53ff6e63c245b89232e1edd104f308 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:32.746506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:32.747043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:32.747146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:32.765123 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:32.766340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:32.834832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1207/2488] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:32.844930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:32.846360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:32.905918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca375f-f1e8-4ca0-b1a5-d0d543e5b172 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:32.909569 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:32.910204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:32.910494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:32.910800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:32.920584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:32.922028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:32.931848 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1282/2489] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:33.412289 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:33.414375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:33.429273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeabac-930c-4b13-b932-3365e014a99b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:33.434937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:33.436274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:33.436274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:33.436512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] PATH_INFO: `/v3/projects/6f64783bdfe240979401eb2ea503c410` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:33.438005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f64783bdfe240979401eb2ea503c410)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:33.440029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:33.557558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f64783bdfe240979401eb2ea503c410', 'request_id': 'req-d6568627-7951-41fa-94a1-f59dd46c2c2e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:33.563785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f64783bdfe240979401eb2ea503c410', 'request_id': 'req-d6568627-7951-41fa-94a1-f59dd46c2c2e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:33.566305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:33.647818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f64783bdfe240979401eb2ea503c410', 'request_id': 'req-d6568627-7951-41fa-94a1-f59dd46c2c2e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:33.659875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] The token cache is being invalidate because project 6f64783bdfe240979401eb2ea503c410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:33.660283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:33.661046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:33.662671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1208/2490] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:33 2022] DELETE /identity/v3/projects/6f64783bdfe240979401eb2ea503c410 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:33.666747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:33.690241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0ebc-c622-4272-a3b4-d4fce730c71c service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:33.765927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:33.767185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:33.767610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:33.767951 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] PATH_INFO: `/v3/users/530728f2e1f446ce8983cdcaa06bde00` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:33.769253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] RBAC: Authorizing `identity:delete_user(user_id=530728f2e1f446ce8983cdcaa06bde00)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:33.771319 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:33.794528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:34.046964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530728f2e1f446ce8983cdcaa06bde00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.150773 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530728f2e1f446ce8983cdcaa06bde00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.151395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530728f2e1f446ce8983cdcaa06bde00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.161072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530728f2e1f446ce8983cdcaa06bde00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.173450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530728f2e1f446ce8983cdcaa06bde00'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.179365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1283/2491] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:33 2022] DELETE /identity/v3/users/530728f2e1f446ce8983cdcaa06bde00 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:52:34.564308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:34.569664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:34.581475 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6568627-7951-41fa-94a1-f59dd46c2c2e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:34.644148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:34.645014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:34.645300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:34.645573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] PATH_INFO: `/v3/projects/2dd0949a45da472bb38f8c68d330ab91` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:34.646840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd0949a45da472bb38f8c68d330ab91)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:34.648756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:34.768432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd0949a45da472bb38f8c68d330ab91', 'request_id': 'req-4603df2f-022c-445b-b8ce-9e071027fd5d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.786810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd0949a45da472bb38f8c68d330ab91', 'request_id': 'req-4603df2f-022c-445b-b8ce-9e071027fd5d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.837870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd0949a45da472bb38f8c68d330ab91', 'request_id': 'req-4603df2f-022c-445b-b8ce-9e071027fd5d'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.852865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] The token cache is being invalidate because project 2dd0949a45da472bb38f8c68d330ab91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:34.853177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.853844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:34.858824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1209/2492] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:34 2022] DELETE /identity/v3/projects/2dd0949a45da472bb38f8c68d330ab91 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:34.860228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:34.861775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:34.878881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee135f4-10f1-4ba9-bbd0-bebe656f124d admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:34.948725 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:34.949640 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:34.949930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:34.950206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] PATH_INFO: `/v3/users/9e17665593414393a5bdea534dd20717` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:34.951968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e17665593414393a5bdea534dd20717)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:34.956216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:35.169624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e17665593414393a5bdea534dd20717'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:35.282298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e17665593414393a5bdea534dd20717'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:35.283135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e17665593414393a5bdea534dd20717'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:35.290929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e17665593414393a5bdea534dd20717'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:35.303436 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-9d9c1412-6c4d-4ad7-982b-52b3b257f197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e17665593414393a5bdea534dd20717'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:35.310747 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1284/2493] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:34 2022] DELETE /identity/v3/users/9e17665593414393a5bdea534dd20717 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:35.982681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:35.984907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:36.009899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603df2f-022c-445b-b8ce-9e071027fd5d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.088624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.089624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.089764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.090222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] PATH_INFO: `/v3/projects/bb1ce49cbfcb4e2b83dd546d3ebb2743` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.091575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1ce49cbfcb4e2b83dd546d3ebb2743)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.093645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:36.115243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:36.248031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1ce49cbfcb4e2b83dd546d3ebb2743', 'request_id': 'req-555b87aa-9618-4481-94bd-a78575ca6190'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:36.259319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1ce49cbfcb4e2b83dd546d3ebb2743', 'request_id': 'req-555b87aa-9618-4481-94bd-a78575ca6190'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:36.350719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1ce49cbfcb4e2b83dd546d3ebb2743', 'request_id': 'req-555b87aa-9618-4481-94bd-a78575ca6190'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:36.363224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] The token cache is being invalidate because project bb1ce49cbfcb4e2b83dd546d3ebb2743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:36.363535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:36.364228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-555b87aa-9618-4481-94bd-a78575ca6190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:36.366823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1210/2494] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:35 2022] DELETE /identity/v3/projects/bb1ce49cbfcb4e2b83dd546d3ebb2743 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:36.373337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.373805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.373915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.392255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:36.393532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:36.403064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:36.452570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1285/2495] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:36.470009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971084f-4607-4292-a657-595cdd073dde None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.470299 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971084f-4607-4292-a657-595cdd073dde None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.470600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971084f-4607-4292-a657-595cdd073dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.490140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2971084f-4607-4292-a657-595cdd073dde None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:36.491409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2971084f-4607-4292-a657-595cdd073dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:36.499721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1211/2496] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:36.504200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:36.513907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d4e3b-926c-4675-ac5c-eb58cf31f507 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.518485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.519195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.519483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.519762 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.520495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:52:36.520803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.522407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:36.534731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1286/2497] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:52:36.539104 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971084f-4607-4292-a657-595cdd073dde None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:36.549432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971084f-4607-4292-a657-595cdd073dde None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.554140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.559988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.559988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.559988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.559988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.559988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:36.643777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1212/2498] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:36 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:36.648183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:36.664449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc90e9-480a-4930-8b28-28304f74ccee admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.715732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.716419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.716705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.716988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.717700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.719666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:36.819820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1287/2499] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:36 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:36.823937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:36.834464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41dde4-5639-4524-9278-c1dfbd87cd39 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.839782 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.843252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.843252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.843252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.843252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.843642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:36.855348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1213/2500] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:36.859573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:36.871217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb75f9d-e71d-49d9-b3aa-bd54e751cb8f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.876155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3416-4dc9-418c-ba36-1066a732b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.876818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3416-4dc9-418c-ba36-1066a732b183 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.877103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3416-4dc9-418c-ba36-1066a732b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.877379 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3416-4dc9-418c-ba36-1066a732b183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.878141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3416-4dc9-418c-ba36-1066a732b183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.879766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3416-4dc9-418c-ba36-1066a732b183 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:36.893334 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1288/2501] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:36.895187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:36.906315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1286-39df-4b41-b8a2-24a1ca8bf7e2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:36.911073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:36.912991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:36.912991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:36.912991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] PATH_INFO: `/v3/projects/e1bf48e63d374aeeb501c52870f1041f/users/540ed7a178154cb0a904b233435b065d/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:36.927493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bf48e63d374aeeb501c52870f1041f, user_id=540ed7a178154cb0a904b233435b065d, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:36.930231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.026268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1214/2502] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:36 2022] PUT /identity/v3/projects/e1bf48e63d374aeeb501c52870f1041f/users/540ed7a178154cb0a904b233435b065d/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:37.038390 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.038680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.038988 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.094047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] MFA Rules not processed for user `540ed7a178154cb0a904b233435b065d`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:37.095631 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:37.168869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1289/2503] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:37.170246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.237614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895923-4e79-48ea-887d-f6b8145d63c2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.247755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.248437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.248725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.249005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.249774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.251889 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.358657 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1215/2504] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:37 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:37.362795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.375767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee162ef-df78-4c2a-8e9b-7f9a7e5f6fa1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.384914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:37.434808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.435490 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.435777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.436062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.436766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.438706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.502863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1290/2505] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:37 2022] POST /identity/v3/users => generated 302 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:37.504124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.515371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1dbf4-486e-4680-a80a-2aa88a6a36d3 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.520074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.520736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.521024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.521305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.522042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.523676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.534618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1216/2506] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:37.538751 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.551182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e615-ce27-4147-8493-230fec7978db admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.556893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.558285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.558285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.558463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] PATH_INFO: `/v3/projects/a077282fdd7b4e68bf932d3e16182402/users/fd0489671abc4127a9baf7cf4344319c/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.575450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a077282fdd7b4e68bf932d3e16182402, user_id=fd0489671abc4127a9baf7cf4344319c, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.578540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.642326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1291/2507] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:37 2022] PUT /identity/v3/projects/a077282fdd7b4e68bf932d3e16182402/users/fd0489671abc4127a9baf7cf4344319c/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:37.646344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.656444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f9a43-43b1-4631-beb2-94801f160888 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.668535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:37.714163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad089-8016-4248-871c-58bb16500976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.714982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad089-8016-4248-871c-58bb16500976 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.715274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad089-8016-4248-871c-58bb16500976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.715551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad089-8016-4248-871c-58bb16500976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.716318 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad089-8016-4248-871c-58bb16500976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.718084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad089-8016-4248-871c-58bb16500976 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.729177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1217/2508] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:37.733290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.744495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc74ba-0dc8-4398-8d29-e1f91b4b8b88 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.749272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.750181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.750465 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.750770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] PATH_INFO: `/v3/projects/a077282fdd7b4e68bf932d3e16182402/users/fd0489671abc4127a9baf7cf4344319c/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.752796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a077282fdd7b4e68bf932d3e16182402, user_id=fd0489671abc4127a9baf7cf4344319c, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.755575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.768500 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1292/2509] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:37 2022] PUT /identity/v3/projects/a077282fdd7b4e68bf932d3e16182402/users/fd0489671abc4127a9baf7cf4344319c/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:37.783269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.783676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.784054 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.814658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] MFA Rules not processed for user `fd0489671abc4127a9baf7cf4344319c`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:37.816118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:37.885248 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1218/2510] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:37.896150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:37.897938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:37.954790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018ddfc-8ca2-41a1-b491-54898ba89bc4 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:37.958424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db8a1a-a7e8-434f-8e58-89201782bebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:37.959110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db8a1a-a7e8-434f-8e58-89201782bebb service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:37.959401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db8a1a-a7e8-434f-8e58-89201782bebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:37.959680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db8a1a-a7e8-434f-8e58-89201782bebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:37.969378 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db8a1a-a7e8-434f-8e58-89201782bebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:37.970849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db8a1a-a7e8-434f-8e58-89201782bebb service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:37.981317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1293/2511] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:38.026242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:38.027685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:38.040211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca3c1-07bb-42db-a454-0670557903ce None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:38.043848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:38.044491 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:38.044802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:38.045080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:38.101746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:38.103759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:38.112752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1219/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:39.079528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:39.080043 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:39.080167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:39.098143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:39.099411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:39.154095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1294/2513] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:39.166968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:39.168390 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:39.208405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:39.238023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79f7b-b081-4ff0-a488-7fb6d16cc32b service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:39.243768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67638ce-e8c5-469d-bc31-e3375facccad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:39.244422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67638ce-e8c5-469d-bc31-e3375facccad service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:39.244709 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67638ce-e8c5-469d-bc31-e3375facccad service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:39.244988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67638ce-e8c5-469d-bc31-e3375facccad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:39.253144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67638ce-e8c5-469d-bc31-e3375facccad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:39.254766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67638ce-e8c5-469d-bc31-e3375facccad service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:39.263641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1220/2514] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:52:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:43.002731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:43.024019 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:43.098550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647a1a5-47ed-470a-a026-a69cdab12034 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:43.104783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:43.106362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:43.106362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:43.106362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] PATH_INFO: `/v3/users/540ed7a178154cb0a904b233435b065d` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:43.107575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540ed7a178154cb0a904b233435b065d)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:43.109585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:43.291249 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540ed7a178154cb0a904b233435b065d'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:43.361802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540ed7a178154cb0a904b233435b065d'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:43.362432 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540ed7a178154cb0a904b233435b065d'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:43.370939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540ed7a178154cb0a904b233435b065d'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:43.390525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540ed7a178154cb0a904b233435b065d'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:43.397017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1295/2515] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:43 2022] DELETE /identity/v3/users/540ed7a178154cb0a904b233435b065d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:43.401932 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518261d-5000-464e-879e-f08481ea0574 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:43.402460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518261d-5000-464e-879e-f08481ea0574 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:43.402565 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518261d-5000-464e-879e-f08481ea0574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:43.422185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3518261d-5000-464e-879e-f08481ea0574 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:43.423555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3518261d-5000-464e-879e-f08481ea0574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:43.491655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1221/2516] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:43.501766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:43.503539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:43.569252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fd17-58a8-4fc6-b5eb-ce80342c3af9 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:43.573266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:43.573934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:43.574259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:43.574565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:43.584837 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:43.587283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:43.598163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1296/2517] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:44.079270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518261d-5000-464e-879e-f08481ea0574 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:44.080975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3518261d-5000-464e-879e-f08481ea0574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:44.095147 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518261d-5000-464e-879e-f08481ea0574 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:44.106916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:44.108494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:44.108784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:44.109060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] PATH_INFO: `/v3/projects/e1bf48e63d374aeeb501c52870f1041f` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:44.112169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bf48e63d374aeeb501c52870f1041f)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:44.114382 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:44.238312 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bf48e63d374aeeb501c52870f1041f', 'request_id': 'req-24632638-a00f-408c-b11a-867b6387ede2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.246519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bf48e63d374aeeb501c52870f1041f', 'request_id': 'req-24632638-a00f-408c-b11a-867b6387ede2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.304658 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bf48e63d374aeeb501c52870f1041f', 'request_id': 'req-24632638-a00f-408c-b11a-867b6387ede2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.316784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] The token cache is being invalidate because project e1bf48e63d374aeeb501c52870f1041f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:44.317077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.317748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.319331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1222/2518] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:44 2022] DELETE /identity/v3/projects/e1bf48e63d374aeeb501c52870f1041f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:44.323537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:44.334463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b578ff8-0942-4388-aee2-385ab5ebcad7 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:44.374136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:44.409425 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:44.411538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:44.411538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:44.412158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] PATH_INFO: `/v3/users/fd0489671abc4127a9baf7cf4344319c` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:44.413780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0489671abc4127a9baf7cf4344319c)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:44.415811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:44.552017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0489671abc4127a9baf7cf4344319c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.612904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0489671abc4127a9baf7cf4344319c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.613692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0489671abc4127a9baf7cf4344319c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.622459 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0489671abc4127a9baf7cf4344319c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.635396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c5c4a465-b9b9-4e59-b122-9bfb45a9e163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0489671abc4127a9baf7cf4344319c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:44.641735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1297/2519] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:44 2022] DELETE /identity/v3/users/fd0489671abc4127a9baf7cf4344319c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:52:45.048862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:45.054062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:45.068634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24632638-a00f-408c-b11a-867b6387ede2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:45.126973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:45.141317 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:45.142291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.142785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.143387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] PATH_INFO: `/v3/projects/a077282fdd7b4e68bf932d3e16182402` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.144687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a077282fdd7b4e68bf932d3e16182402)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:45.146674 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:45.298621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a077282fdd7b4e68bf932d3e16182402', 'request_id': 'req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:45.306034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a077282fdd7b4e68bf932d3e16182402', 'request_id': 'req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:45.367310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a077282fdd7b4e68bf932d3e16182402', 'request_id': 'req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:45.383984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] The token cache is being invalidate because project a077282fdd7b4e68bf932d3e16182402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:45.383984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:45.383984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-98a235d3-1246-41c4-a4e3-c5f6f18b1a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:45.385750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1223/2520] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:45 2022] DELETE /identity/v3/projects/a077282fdd7b4e68bf932d3e16182402 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:45.391131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67777-dacb-461e-878d-553a53d6537c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.391738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67777-dacb-461e-878d-553a53d6537c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.391857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67777-dacb-461e-878d-553a53d6537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.411477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-90d67777-dacb-461e-878d-553a53d6537c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:45.412733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-90d67777-dacb-461e-878d-553a53d6537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:45.484674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1298/2521] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:45.494029 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.494937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.495320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.530471 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:45.531850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:45.541349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1224/2522] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:45.545533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67777-dacb-461e-878d-553a53d6537c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:45.556435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67777-dacb-461e-878d-553a53d6537c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:45.561824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:45.562511 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.562820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.563096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.563835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:52:45.564142 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:45.565775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:45.578809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1299/2523] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:52:45.583186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:45.599391 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9c461-bcd9-43ff-8ce3-9694bc3fec4e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:45.605973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:45.606644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.606955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.607230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.607936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:45.609855 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:45.743572 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1225/2524] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:45 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:45.744886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:45.767102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a5ac-b8eb-44cc-a0de-f54768526225 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:45.823111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:45.855031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:45.855723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.856007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.856283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.856983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:45.859171 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:45.954001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1300/2525] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:45 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:45.955063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:45.966212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe4ac-50d2-4612-8a46-a03eedfe28b6 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:45.973854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:45.974781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:45.975173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:45.975563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:45.977253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:45.979268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.004772 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1226/2526] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:46.006299 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.018894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6862c69-7cda-4f14-82dd-4223da28f3e8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.024231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99fda-4376-4ad7-b10a-5d6f4778924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.025018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99fda-4376-4ad7-b10a-5d6f4778924c admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.025374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99fda-4376-4ad7-b10a-5d6f4778924c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.025748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99fda-4376-4ad7-b10a-5d6f4778924c admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.026573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99fda-4376-4ad7-b10a-5d6f4778924c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.028291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99fda-4376-4ad7-b10a-5d6f4778924c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.040946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1301/2527] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:46.045110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.057353 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b4706-60d6-465d-8680-4b6641ea0872 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.062640 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.072492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.072492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.072492 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] PATH_INFO: `/v3/projects/8dc78604483f4aa4a4a1f5ac5d5d2fea/users/14f4b1b614564f48aeb76c5054f3637f/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.082032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc78604483f4aa4a4a1f5ac5d5d2fea, user_id=14f4b1b614564f48aeb76c5054f3637f, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.084955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.178980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1227/2528] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:46 2022] PUT /identity/v3/projects/8dc78604483f4aa4a4a1f5ac5d5d2fea/users/14f4b1b614564f48aeb76c5054f3637f/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:46.251804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.252099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.252383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.288656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] MFA Rules not processed for user `14f4b1b614564f48aeb76c5054f3637f`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:46.289523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:46.365846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1302/2529] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:46.371132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.438387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e200-2424-4b35-b26e-f24e8b0c7981 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.443137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.443800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.444088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.444368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.445688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.448046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.529365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:46.540145 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1228/2530] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:46 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:46.541654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.552982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285e61-6bdf-4ebe-ac22-9e2865028a8a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.619557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.620151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.620442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.620719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.621443 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.623484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.697059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1303/2531] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:46 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:46.698241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.709215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eafe67-cf6a-487e-83f7-9f3695410429 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.714663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.715920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.715920 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.716179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.717118 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.719235 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.738264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1229/2532] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:46.739422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.750955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c6d7-cde7-4def-a9d6-1af6e3feb13f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.755831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.759250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.759250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.759250 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] PATH_INFO: `/v3/projects/70605a39c84d4c4cad75b6e12882fa3e/users/44705695269f4c17835c9d1cb051bec6/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.788145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70605a39c84d4c4cad75b6e12882fa3e, user_id=44705695269f4c17835c9d1cb051bec6, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.793338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:46.871759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1304/2533] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:46 2022] PUT /identity/v3/projects/70605a39c84d4c4cad75b6e12882fa3e/users/44705695269f4c17835c9d1cb051bec6/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:46.876119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:46.887950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c13e-8aad-422e-8d32-85722aede285 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:46.982434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b4d94-7894-4eb3-aa12-a317da5cd02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:46.984636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b4d94-7894-4eb3-aa12-a317da5cd02c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:46.985105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b4d94-7894-4eb3-aa12-a317da5cd02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:46.985540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b4d94-7894-4eb3-aa12-a317da5cd02c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:46.986968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b4d94-7894-4eb3-aa12-a317da5cd02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:46.988927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b4d94-7894-4eb3-aa12-a317da5cd02c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:47.003771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1230/2534] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:47.005086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:47.019248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1712a-eec6-42d9-9c2c-5c9503bb02e4 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:47.027978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:47.029202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:47.029565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:47.029845 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] PATH_INFO: `/v3/projects/70605a39c84d4c4cad75b6e12882fa3e/users/44705695269f4c17835c9d1cb051bec6/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:47.032247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70605a39c84d4c4cad75b6e12882fa3e, user_id=44705695269f4c17835c9d1cb051bec6, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:47.035438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:47.042462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:47.047543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1305/2535] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:47 2022] PUT /identity/v3/projects/70605a39c84d4c4cad75b6e12882fa3e/users/44705695269f4c17835c9d1cb051bec6/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:47.067046 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:47.067631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:47.067631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:47.101655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] MFA Rules not processed for user `44705695269f4c17835c9d1cb051bec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:47.103087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:47.181253 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1231/2536] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:47.192077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:47.194056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:47.264514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230368-8063-41df-b227-61343de00bb1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:47.268326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:47.268994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:47.269283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:47.269564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:47.280252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:47.281695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:47.293177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1306/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:47.395128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:47.406422 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dc8b0-3113-463c-a748-46bbd0bdf59a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:47.410069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c007-5a89-468c-85ff-4029ccaf723d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:47.410830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c007-5a89-468c-85ff-4029ccaf723d service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:47.411161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c007-5a89-468c-85ff-4029ccaf723d service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:47.411524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c007-5a89-468c-85ff-4029ccaf723d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:47.473837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c007-5a89-468c-85ff-4029ccaf723d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:47.475307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c007-5a89-468c-85ff-4029ccaf723d service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:47.484548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1232/2538] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:50.475029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:50.543982 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47df44-a191-4f2f-8943-73c4c82e91d2 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:50.548627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:50.549525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:50.549806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:50.550076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] PATH_INFO: `/v3/users/14f4b1b614564f48aeb76c5054f3637f` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:50.551291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f4b1b614564f48aeb76c5054f3637f)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:50.553222 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:50.746391 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f4b1b614564f48aeb76c5054f3637f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:50.806644 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f4b1b614564f48aeb76c5054f3637f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:50.807383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f4b1b614564f48aeb76c5054f3637f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:50.815312 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f4b1b614564f48aeb76c5054f3637f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:50.827696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f4b1b614564f48aeb76c5054f3637f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:50.834179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1307/2539] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:50 2022] DELETE /identity/v3/users/14f4b1b614564f48aeb76c5054f3637f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:50.839448 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:50.841326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:50.841326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:50.860229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:50.861451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:50.865555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:50.929708 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1233/2540] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:50.939592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:50.941014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:50.968537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:51.002890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee34e8-c80e-4ad4-a6b0-2fd01f84e3dc admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:51.006450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:51.007136 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:51.007426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:51.007702 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:51.017234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:51.018679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:51.029050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1308/2541] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:52:51.470820 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:51.472257 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:51.485613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afffc7-aaeb-4d66-ab27-10e9e42710f4 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:51.490528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:51.491426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:51.491711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:51.493025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] PATH_INFO: `/v3/projects/8dc78604483f4aa4a4a1f5ac5d5d2fea` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:51.494362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc78604483f4aa4a4a1f5ac5d5d2fea)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:51.496371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:51.637574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc78604483f4aa4a4a1f5ac5d5d2fea', 'request_id': 'req-6ab7f686-8708-40f8-909b-63bd11308bab'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:51.644015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc78604483f4aa4a4a1f5ac5d5d2fea', 'request_id': 'req-6ab7f686-8708-40f8-909b-63bd11308bab'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:51.726425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc78604483f4aa4a4a1f5ac5d5d2fea', 'request_id': 'req-6ab7f686-8708-40f8-909b-63bd11308bab'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:51.737945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] The token cache is being invalidate because project 8dc78604483f4aa4a4a1f5ac5d5d2fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:51.738466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:51.739284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:51.740978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1234/2542] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:51 2022] DELETE /identity/v3/projects/8dc78604483f4aa4a4a1f5ac5d5d2fea => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:51.745527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:51.755509 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594805b-9379-40d6-9e1f-8f4d986ed715 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:51.815176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:51.819467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:51.819467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:51.819467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] PATH_INFO: `/v3/users/44705695269f4c17835c9d1cb051bec6` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:51.819467 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44705695269f4c17835c9d1cb051bec6)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:51.819892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:51.961763 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44705695269f4c17835c9d1cb051bec6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.011752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44705695269f4c17835c9d1cb051bec6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.012372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44705695269f4c17835c9d1cb051bec6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.019700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44705695269f4c17835c9d1cb051bec6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.031626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c8d22896-ccbf-4631-97ae-534b7a889f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44705695269f4c17835c9d1cb051bec6'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.037620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1309/2543] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:51 2022] DELETE /identity/v3/users/44705695269f4c17835c9d1cb051bec6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:52.441449 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:52.442927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:52.459760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f686-8708-40f8-909b-63bd11308bab admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:52.515345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:52.516213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:52.516499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:52.516776 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] PATH_INFO: `/v3/projects/70605a39c84d4c4cad75b6e12882fa3e` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:52.517963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] RBAC: Authorizing `identity:delete_project(project_id=70605a39c84d4c4cad75b6e12882fa3e)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:52.519909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:52.592215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:52.601472 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70605a39c84d4c4cad75b6e12882fa3e', 'request_id': 'req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.607949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70605a39c84d4c4cad75b6e12882fa3e', 'request_id': 'req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.645948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70605a39c84d4c4cad75b6e12882fa3e', 'request_id': 'req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.657569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] The token cache is being invalidate because project 70605a39c84d4c4cad75b6e12882fa3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:52.657848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.658468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-9f7ea29c-a0c2-4051-86f4-58ddee1aeaec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:52.660036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1235/2544] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:52 2022] DELETE /identity/v3/projects/70605a39c84d4c4cad75b6e12882fa3e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:52.665020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:52.665365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:52.665646 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:52.683564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:52.684887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:52.726150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:52.745177 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1310/2545] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:52.754777 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:52.755070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:52.755354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:52.775271 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:52.776560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:52.788824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1236/2546] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:52.789869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:52.799620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2c671-4519-49a2-b9da-28f9c7a1d17e None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:52.804411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:52.805164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:52.805618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:52.805913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:52.806651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:52:52.806998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:52.808606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:52.822320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1311/2547] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:52:52.826682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:52.837082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efa04e-3d51-427b-9340-42b719e972ae None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:52.842005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:52.842778 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:52.843064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:52.843341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:52.844034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:52.846194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:52.927575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1237/2548] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:52 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:52.932327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:52.942401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8339e25-0e67-423d-b2d3-f288a9363e07 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.000182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.000849 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.001132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.001407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.002089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.004131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.112031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1312/2549] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:52 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:53.113542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.124857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d6c46-a223-410b-8569-cca8535ddb10 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.129646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.130322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.130633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.130938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.131676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.133845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.144398 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1238/2550] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:53.148417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.158589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f98b88-62b0-4b3a-9d10-3181f8fb78f2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.163371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fbcd0-e53a-4cdd-afd0-ccbd52cae2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.164062 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fbcd0-e53a-4cdd-afd0-ccbd52cae2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.164447 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fbcd0-e53a-4cdd-afd0-ccbd52cae2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.164731 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fbcd0-e53a-4cdd-afd0-ccbd52cae2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.165470 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fbcd0-e53a-4cdd-afd0-ccbd52cae2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.167116 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fbcd0-e53a-4cdd-afd0-ccbd52cae2fd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.177404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1313/2551] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:52:53.188619 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.199288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c05f90-380b-4d1d-8d87-2059a0e3e650 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.203960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.204865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.205154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.205434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] PATH_INFO: `/v3/projects/edeb4a87032d466eb153e828c4d28e62/users/388c69748f9f415184d93e614420cc85/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.222220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edeb4a87032d466eb153e828c4d28e62, user_id=388c69748f9f415184d93e614420cc85, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.225018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.349386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1239/2552] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:53 2022] PUT /identity/v3/projects/edeb4a87032d466eb153e828c4d28e62/users/388c69748f9f415184d93e614420cc85/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:53.360645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.361015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.361366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.390314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] MFA Rules not processed for user `388c69748f9f415184d93e614420cc85`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:53.391683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:53.458972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1314/2553] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:53.463489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.535832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2945-450e-4c1e-8c6d-7b0aea77835d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.541429 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.542087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.542368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.542642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.543373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.545274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.647997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1240/2554] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:53 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:52:53.652193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.663581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb2bb-651a-4de0-ab68-ca5fb82bd7c6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.704498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:53.722969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.723578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.723866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.724143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.724835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.727527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.816622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1315/2555] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:53 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:53.817774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.828856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868bb63-79e9-489e-9622-5fc82ea02dfb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.833798 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.834480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.834795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.835076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.836535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.838349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.850149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1241/2556] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:53.856744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.866890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4daa-844a-4a8f-8d89-cf2850cfa0a8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:53.872172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:53.876273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:53.876273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:53.876273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] PATH_INFO: `/v3/projects/38ea200ddd4748a5a790c0639042f562/users/97df60a83b7f41058230aeccfc2ea133/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:53.890220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ea200ddd4748a5a790c0639042f562, user_id=97df60a83b7f41058230aeccfc2ea133, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:53.894155 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:53.961258 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1316/2557] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:53 2022] PUT /identity/v3/projects/38ea200ddd4748a5a790c0639042f562/users/97df60a83b7f41058230aeccfc2ea133/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:53.965649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:53.976236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2871ca-fe83-45b9-b331-04b34f522022 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:54.008259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:54.035921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495d189-3570-49fb-a176-232aec3ca455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:54.036638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495d189-3570-49fb-a176-232aec3ca455 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:54.036923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495d189-3570-49fb-a176-232aec3ca455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:54.037198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495d189-3570-49fb-a176-232aec3ca455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:54.037935 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495d189-3570-49fb-a176-232aec3ca455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:54.040214 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495d189-3570-49fb-a176-232aec3ca455 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:54.051073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1242/2558] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:52:54.055054 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:54.065934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf4c50-1fd7-4543-a980-bc72dfb7206f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:54.071521 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:54.072407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:54.072688 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:54.072963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] PATH_INFO: `/v3/projects/38ea200ddd4748a5a790c0639042f562/users/97df60a83b7f41058230aeccfc2ea133/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:54.074998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ea200ddd4748a5a790c0639042f562, user_id=97df60a83b7f41058230aeccfc2ea133, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:54.077693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:54.089079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1317/2559] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:54 2022] PUT /identity/v3/projects/38ea200ddd4748a5a790c0639042f562/users/97df60a83b7f41058230aeccfc2ea133/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:54.099933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df896527-e8f9-4513-a486-c92cf851938a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:54.100227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df896527-e8f9-4513-a486-c92cf851938a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:54.100507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df896527-e8f9-4513-a486-c92cf851938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:54.126057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-df896527-e8f9-4513-a486-c92cf851938a None None] MFA Rules not processed for user `97df60a83b7f41058230aeccfc2ea133`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:54.127288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-df896527-e8f9-4513-a486-c92cf851938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:54.194678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1243/2560] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:54.206104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:54.207817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:54.266302 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425183-a3bb-44de-a6af-f4da8cd1051e admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:54.269911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e615-c0db-44c0-a398-8529ca1cdd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:54.270559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e615-c0db-44c0-a398-8529ca1cdd2d service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:54.270885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e615-c0db-44c0-a398-8529ca1cdd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:54.271203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e615-c0db-44c0-a398-8529ca1cdd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:54.281013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e615-c0db-44c0-a398-8529ca1cdd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:54.282445 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e615-c0db-44c0-a398-8529ca1cdd2d service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:54.292179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1318/2561] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:52:54.775389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df896527-e8f9-4513-a486-c92cf851938a None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:54.841462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df896527-e8f9-4513-a486-c92cf851938a None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:54.846467 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:54.847377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:54.847661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:54.848006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] PATH_INFO: `/v3/users/388c69748f9f415184d93e614420cc85` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:54.849265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388c69748f9f415184d93e614420cc85)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:54.851235 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:55.025559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388c69748f9f415184d93e614420cc85'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.086879 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388c69748f9f415184d93e614420cc85'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.089404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:55.103295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388c69748f9f415184d93e614420cc85'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.103995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388c69748f9f415184d93e614420cc85'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.118202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f5894a83-3424-4a72-8b38-953ccf164f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388c69748f9f415184d93e614420cc85'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.131224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1244/2562] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:54 2022] DELETE /identity/v3/users/388c69748f9f415184d93e614420cc85 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:55.136514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:55.137502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:55.137979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:55.149136 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:55.149553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:55.149949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:55.161162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:55.162405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:55.173986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:55.175547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:55.232154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1319/2563] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:55.243901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:55.243901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:55.249556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1245/2564] 10.222.0.49 () {58 vars in 967 bytes} [Thu Jul 21 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:52:55.262370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:55.263780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:55.286431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:55.303703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2b642-2626-45f8-9e58-713b2c51d098 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:55.308248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:55.308910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:55.309196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:55.309526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:55.320927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:55.322422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:55.332565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1320/2565] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:52:55.335019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edb7c-3706-46b5-be73-af69349fd094 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:55.340683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:55.341349 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:55.341660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:55.341947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:55.350821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:55.352566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:55.360854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1246/2566] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:52:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 10:52:55.757588 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:55.759162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:55.780317 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9614f5-e382-4f19-8436-f557a6e87c05 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:55.787198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:55.788104 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:55.788392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:55.788680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] PATH_INFO: `/v3/projects/edeb4a87032d466eb153e828c4d28e62` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:55.790402 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edeb4a87032d466eb153e828c4d28e62)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:55.792383 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:55.905530 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edeb4a87032d466eb153e828c4d28e62', 'request_id': 'req-290236f3-195f-4b4a-aeea-3326c1bef815'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.912072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edeb4a87032d466eb153e828c4d28e62', 'request_id': 'req-290236f3-195f-4b4a-aeea-3326c1bef815'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:55.988410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edeb4a87032d466eb153e828c4d28e62', 'request_id': 'req-290236f3-195f-4b4a-aeea-3326c1bef815'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.000307 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] The token cache is being invalidate because project edeb4a87032d466eb153e828c4d28e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:56.000593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.001241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.002794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1321/2567] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:55 2022] DELETE /identity/v3/projects/edeb4a87032d466eb153e828c4d28e62 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:56.006967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:56.017973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd2e64-6657-4d55-b3ab-36a69826fc66 service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:56.075308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:56.076212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:56.077222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:56.077222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] PATH_INFO: `/v3/users/97df60a83b7f41058230aeccfc2ea133` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:56.077994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97df60a83b7f41058230aeccfc2ea133)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:56.079979 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:56.090464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:56.244035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97df60a83b7f41058230aeccfc2ea133'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.348703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97df60a83b7f41058230aeccfc2ea133'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.362444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97df60a83b7f41058230aeccfc2ea133'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.363181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97df60a83b7f41058230aeccfc2ea133'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.371862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6f355047-96ca-4ccf-b76c-ea452b921b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97df60a83b7f41058230aeccfc2ea133'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:56.378016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1247/2568] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:52:56 2022] DELETE /identity/v3/users/97df60a83b7f41058230aeccfc2ea133 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:52:57.030946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.032321 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:57.049161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290236f3-195f-4b4a-aeea-3326c1bef815 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.107720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.108645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.109069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.109354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] PATH_INFO: `/v3/projects/38ea200ddd4748a5a790c0639042f562` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.110613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ea200ddd4748a5a790c0639042f562)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.112581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.206158 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ea200ddd4748a5a790c0639042f562', 'request_id': 'req-c402797e-1b34-46d3-9fe8-60391d7aed39'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:57.213034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ea200ddd4748a5a790c0639042f562', 'request_id': 'req-c402797e-1b34-46d3-9fe8-60391d7aed39'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:57.296513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ea200ddd4748a5a790c0639042f562', 'request_id': 'req-c402797e-1b34-46d3-9fe8-60391d7aed39'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:57.298532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:57.307648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] The token cache is being invalidate because project 38ea200ddd4748a5a790c0639042f562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:52:57.307935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:57.308597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c402797e-1b34-46d3-9fe8-60391d7aed39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:52:57.310188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1322/2569] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:52:57 2022] DELETE /identity/v3/projects/38ea200ddd4748a5a790c0639042f562 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:57.315098 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.315555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.315651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.336687 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:57.338051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:57.396710 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1248/2570] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:57.404976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.405260 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.405536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.424262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:57.425550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:57.434254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1323/2571] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:57.438629 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.449112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84136-cc2c-486c-ae84-d807426d4444 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.454148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.454854 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.455137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.455412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.456211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:52:57.456521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.458119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.470589 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1249/2572] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:52:57.474574 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.483772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b582e5-c573-45f4-ae3f-58196c6b2769 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.488657 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.489325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.489607 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.489883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.490592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.493380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.560130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1324/2573] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:52:57 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:57.561181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.572163 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7800076-3e25-40c1-b22f-cc5de868c83a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.629503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.630176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.630464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.630774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.631474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.634042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.708284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1250/2574] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:52:57 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:52:57.712775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.723475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a371-f4bc-4351-823a-6ad31d8bfc29 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.728579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.729241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.729529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.729806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.730537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.732164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.742981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1325/2575] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:52:57.746891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.753151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:57.756857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742e254-db07-4280-b6bb-3b5da9909716 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.762272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f209273-b9aa-4f46-a9fd-6c3b5a44de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.765112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209273-b9aa-4f46-a9fd-6c3b5a44de7c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.765112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209273-b9aa-4f46-a9fd-6c3b5a44de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.765112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209273-b9aa-4f46-a9fd-6c3b5a44de7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.765112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f209273-b9aa-4f46-a9fd-6c3b5a44de7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.765764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f209273-b9aa-4f46-a9fd-6c3b5a44de7c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.776731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1251/2576] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:52:57.780618 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:57.791380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5469d6-cf14-4da9-8aee-89af49cfdd4b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:57.796036 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:57.796947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.797227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.797503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] PATH_INFO: `/v3/projects/d3a843425e7f401194786a544705a3d5/users/9aaf77ec389c47de9b269da0ebd68b21/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.813188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a843425e7f401194786a544705a3d5, user_id=9aaf77ec389c47de9b269da0ebd68b21, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:57.815980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:57.902836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1326/2577] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:52:57 2022] PUT /identity/v3/projects/d3a843425e7f401194786a544705a3d5/users/9aaf77ec389c47de9b269da0ebd68b21/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:52:57.913347 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:57.913638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:57.913915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:57.940677 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] MFA Rules not processed for user `9aaf77ec389c47de9b269da0ebd68b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:52:57.941896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:58.007357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1252/2578] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:52:58.018679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:52:58.020497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:52:58.076719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b8e8-85b0-4b68-956a-d25f040221ad admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:52:58.080325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1666a-b1b6-405b-8303-315ef5a5a559 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:52:58.080972 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1666a-b1b6-405b-8303-315ef5a5a559 service glance] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:52:58.081252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1666a-b1b6-405b-8303-315ef5a5a559 service glance] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:52:58.081526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1666a-b1b6-405b-8303-315ef5a5a559 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:52:58.089957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1666a-b1b6-405b-8303-315ef5a5a559 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:52:58.091411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1666a-b1b6-405b-8303-315ef5a5a559 service glance] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:52:58.100504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1327/2579] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:52:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:08.004660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=35 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:08.096494 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:15.358183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:15.426482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9130c4-f185-498a-94fe-ee0e857e9199 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:15.431819 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:15.432770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:15.433059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:15.433335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] PATH_INFO: `/v3/users/9aaf77ec389c47de9b269da0ebd68b21` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:15.434556 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aaf77ec389c47de9b269da0ebd68b21)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:15.436603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:15.611991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aaf77ec389c47de9b269da0ebd68b21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:15.696417 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aaf77ec389c47de9b269da0ebd68b21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:15.709071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aaf77ec389c47de9b269da0ebd68b21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:15.709704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aaf77ec389c47de9b269da0ebd68b21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:15.717065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aaf77ec389c47de9b269da0ebd68b21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:15.723415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1253/2580] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:53:15 2022] DELETE /identity/v3/users/9aaf77ec389c47de9b269da0ebd68b21 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:15.727938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:15.728433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:15.728538 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:15.746572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:15.747831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:15.809595 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1328/2581] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:15.819597 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:15.821563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:15.881096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471438-c4d8-4247-8176-e4edd1e50d65 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:15.884892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06fa50-4091-499e-9372-a3d575845518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:15.885551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06fa50-4091-499e-9372-a3d575845518 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:15.885835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06fa50-4091-499e-9372-a3d575845518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:15.886110 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06fa50-4091-499e-9372-a3d575845518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:15.895162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06fa50-4091-499e-9372-a3d575845518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:15.896585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06fa50-4091-499e-9372-a3d575845518 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:15.906661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1254/2582] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:16.376540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:16.378095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:16.390404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b40ed1-316e-44f7-822d-1f0531fb49e6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:16.395865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:16.396014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:16.396221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:16.396495 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] PATH_INFO: `/v3/projects/d3a843425e7f401194786a544705a3d5` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:16.397693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a843425e7f401194786a544705a3d5)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:16.400231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:16.536839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a843425e7f401194786a544705a3d5', 'request_id': 'req-3b39a184-c38f-4fa5-b9fe-143978949030'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:16.542076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a843425e7f401194786a544705a3d5', 'request_id': 'req-3b39a184-c38f-4fa5-b9fe-143978949030'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:16.621115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a843425e7f401194786a544705a3d5', 'request_id': 'req-3b39a184-c38f-4fa5-b9fe-143978949030'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:16.632109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] The token cache is being invalidate because project d3a843425e7f401194786a544705a3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:53:16.632973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:16.633564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3b39a184-c38f-4fa5-b9fe-143978949030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:16.635146 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1329/2583] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:53:16 2022] DELETE /identity/v3/projects/d3a843425e7f401194786a544705a3d5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:16.640393 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:16.640877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:16.640984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:16.659614 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:16.660866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:16.678452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:16.720961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1255/2584] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:16.730886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:16.731405 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:16.731586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:16.753962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:16.755254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:16.764673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1330/2585] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:16.769267 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:16.780446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8669cab-ac6d-46d6-8508-2ad7c3c2cb3e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:16.791702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:16.792379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:16.792663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:16.792938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:16.793688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:53:16.793996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:16.795625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:16.808187 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1256/2586] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:53:16.812558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:16.822216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeafa5-240b-41b1-9e3a-f5625eaf4033 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:16.827031 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:16.827689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:16.827999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:16.828276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:16.828970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:16.830901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:16.936676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1331/2587] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:53:16 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:16.941019 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:16.951141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856690-edc9-4440-a71d-a7e4ea6f8848 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:17.008555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:17.009181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:17.009470 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:17.009752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:17.010466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:17.012428 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:17.124224 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1257/2588] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:53:16 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:17.128162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:17.138488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb291-bc23-4f11-9f1c-80784d680093 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:17.143238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:17.143898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:17.144180 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:17.144453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:17.145179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:17.146804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:17.158933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1332/2589] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:17.162901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:17.173791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1af8a-6523-4c00-bd10-cddf22976f0b admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:17.178662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2d6f2-b4f8-46e1-aea0-772598fa9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:17.179360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d6f2-b4f8-46e1-aea0-772598fa9ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:17.179649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d6f2-b4f8-46e1-aea0-772598fa9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:17.179940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d6f2-b4f8-46e1-aea0-772598fa9ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:17.180700 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2d6f2-b4f8-46e1-aea0-772598fa9ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:17.182351 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2d6f2-b4f8-46e1-aea0-772598fa9ae6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:17.192358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1258/2590] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:17.196406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:17.207269 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046e1d-6959-4629-97d4-eceb302036a3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:17.212139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:17.213559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:17.213866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:17.214156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] PATH_INFO: `/v3/projects/48f4c37f8b014939a73370b2cc78b499/users/7e5f76590cfb427b9aeb00d5e829db54/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:17.229047 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f4c37f8b014939a73370b2cc78b499, user_id=7e5f76590cfb427b9aeb00d5e829db54, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:17.231726 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:17.312953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1333/2591] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:53:17 2022] PUT /identity/v3/projects/48f4c37f8b014939a73370b2cc78b499/users/7e5f76590cfb427b9aeb00d5e829db54/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:17.323719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:17.324231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:17.324554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:17.351810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] MFA Rules not processed for user `7e5f76590cfb427b9aeb00d5e829db54`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:17.353028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:17.420850 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1259/2592] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:17.431886 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:17.433606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:17.455976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:17.491793 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593463e1-32bd-457d-9755-29447c4c5279 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:17.495446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:17.496252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:17.496547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:17.496824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:17.505135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:17.506928 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:17.516950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1334/2593] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:19.341237 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:19.343763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:19.366493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:19.404910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92725bbd-ee25-4e3c-be38-9846e990bddd None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:19.409345 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:19.410091 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:19.410310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:19.410585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:19.412385 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:19.476507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:19.477980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:19.488695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1260/2594] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:23.719822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:23.721401 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:23.738956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3e3a5-e2bc-49cd-858c-482dd6bf170a service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:23.743641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:23.744519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:23.744806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:23.745076 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] PATH_INFO: `/v3/users/d1282d4187a54299836bb6b4300d15c1` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:23.747059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1282d4187a54299836bb6b4300d15c1)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:23.748990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:23.989410 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1282d4187a54299836bb6b4300d15c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.065970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1282d4187a54299836bb6b4300d15c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.066584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1282d4187a54299836bb6b4300d15c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.074060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1282d4187a54299836bb6b4300d15c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.085783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ba9b6685-f879-4ee7-912c-76f76db3c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1282d4187a54299836bb6b4300d15c1'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.091820 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1335/2595] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:53:23 2022] DELETE /identity/v3/users/d1282d4187a54299836bb6b4300d15c1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:24.365198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:24.377546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012ae0-b747-4392-8550-a8442bcd3f63 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:24.436973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:24.437841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.438126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.438416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] PATH_INFO: `/v3/projects/3b255ebf80ff409dab26dca4145f7a39` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.439630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b255ebf80ff409dab26dca4145f7a39)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:24.441594 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:24.535715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b255ebf80ff409dab26dca4145f7a39', 'request_id': 'req-d6dc3793-aac0-42a6-88ed-d86b517f1a48'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.541874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b255ebf80ff409dab26dca4145f7a39', 'request_id': 'req-d6dc3793-aac0-42a6-88ed-d86b517f1a48'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.591943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b255ebf80ff409dab26dca4145f7a39', 'request_id': 'req-d6dc3793-aac0-42a6-88ed-d86b517f1a48'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.599032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:24.603523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] The token cache is being invalidate because project 3b255ebf80ff409dab26dca4145f7a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:53:24.608579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.608579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d6dc3793-aac0-42a6-88ed-d86b517f1a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:24.608579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1261/2596] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:53:24 2022] DELETE /identity/v3/projects/3b255ebf80ff409dab26dca4145f7a39 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:53:24.611938 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.612263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.612564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.630161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:24.631583 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:24.690362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1336/2597] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:24.698096 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.698942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.699225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.718321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:24.719568 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:24.727526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1262/2598] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:24.731656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:24.741473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a2f5a-2bf7-4d8e-b665-d99646da52bd None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:24.746060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:24.746772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.747064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.747340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.748069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:53:24.748377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:24.749958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:24.762102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1337/2599] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:53:24.766209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:24.775652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1acd8-df20-47f7-af15-051f0d944212 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:24.781076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:24.781735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.782018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.782292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.783034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:24.784952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:24.811172 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:24.812881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:24.826161 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5a7af-aef7-4417-81f5-93c77fc1dccd admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:24.830828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:24.831706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.831987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.832259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] PATH_INFO: `/v3/users/7e5f76590cfb427b9aeb00d5e829db54` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.833460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5f76590cfb427b9aeb00d5e829db54)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:24.835426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:24.852342 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:24.878963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1263/2600] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:53:24 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:53:24.882995 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:24.950540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725ba2a-9987-4a5b-a64e-54c5c1243a42 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:24.955377 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:24.956151 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:24.956436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:24.956729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:24.957399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:24.959338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:24.988557 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5f76590cfb427b9aeb00d5e829db54'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.043721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5f76590cfb427b9aeb00d5e829db54'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.044365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5f76590cfb427b9aeb00d5e829db54'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.050093 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1264/2601] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:53:24 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:53:25.051839 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5f76590cfb427b9aeb00d5e829db54'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.054177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:25.055852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:25.064983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-af08b95a-fa1c-4da9-98bc-00c461d9fd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5f76590cfb427b9aeb00d5e829db54'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.068712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc2b71-4598-4265-b535-541d984d94bd admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:25.070884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1338/2602] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:53:24 2022] DELETE /identity/v3/users/7e5f76590cfb427b9aeb00d5e829db54 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:53:25.075514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.075807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.076084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.092968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:25.094324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:25.127520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:25.131144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.131144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.131144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.131144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:25.131144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:25.141724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1265/2603] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:25.145553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:25.156069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1339/2604] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:53:25.156334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170617-294e-4719-bd65-712f58d692cd admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:25.161251 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:25.161908 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.162191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.162494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.163256 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:25.164974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:25.166133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:25.168226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:25.175875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1266/2605] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:53:25.179844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:25.189334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6369-ec9a-4502-8aa6-3e292c5be78a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:25.194063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:25.194943 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.195223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.195495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] PATH_INFO: `/v3/projects/06b7b1a51344493c8bbf3f1e716423ab/users/742c006e980a48be88166beeb882a94b/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.211071 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b7b1a51344493c8bbf3f1e716423ab, user_id=742c006e980a48be88166beeb882a94b, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:25.214487 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:25.225961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6083-dc35-455f-ae86-fbd0d81d3522 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:25.229728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de90e6-462f-4df1-8812-94429dbab967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:25.230902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de90e6-462f-4df1-8812-94429dbab967 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.231196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de90e6-462f-4df1-8812-94429dbab967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.231478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de90e6-462f-4df1-8812-94429dbab967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.240615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de90e6-462f-4df1-8812-94429dbab967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:25.242044 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de90e6-462f-4df1-8812-94429dbab967 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:25.251956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1340/2606] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:53:25.288953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1267/2607] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:53:25 2022] PUT /identity/v3/projects/06b7b1a51344493c8bbf3f1e716423ab/users/742c006e980a48be88166beeb882a94b/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:53:25.301151 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.301452 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.301737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.329114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] MFA Rules not processed for user `742c006e980a48be88166beeb882a94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:25.330347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:25.358680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:25.395614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1341/2608] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:25.407552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:25.409732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:25.433260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:25.490504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e2e02-d3f3-4247-bf8e-40d52aec4bc0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:25.496590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:25.497290 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.497638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.497927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.506900 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:25.509011 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:25.518293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1268/2609] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:25.657692 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:25.659758 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:25.731188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1236c1-d1d8-49b8-a46a-1be286ecafd1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:25.735795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:25.736673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:25.736957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:25.737246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] PATH_INFO: `/v3/projects/48f4c37f8b014939a73370b2cc78b499` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:25.738422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f4c37f8b014939a73370b2cc78b499)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:25.740394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:25.838809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f4c37f8b014939a73370b2cc78b499', 'request_id': 'req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.845724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f4c37f8b014939a73370b2cc78b499', 'request_id': 'req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.894679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f4c37f8b014939a73370b2cc78b499', 'request_id': 'req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.905866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] The token cache is being invalidate because project 48f4c37f8b014939a73370b2cc78b499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:53:25.906095 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.906769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b6a1b0d9-d1aa-4f30-8cb7-703e1b85f387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:25.908622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1342/2610] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:53:25 2022] DELETE /identity/v3/projects/48f4c37f8b014939a73370b2cc78b499 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:31.753168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:31.762381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887da7fd-ebd7-44bc-a611-664dd60f9ba8 service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:31.823112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:31.824000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:31.824282 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:31.824555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] PATH_INFO: `/v3/users/742c006e980a48be88166beeb882a94b` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:31.825748 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742c006e980a48be88166beeb882a94b)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:31.827790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:32.028631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742c006e980a48be88166beeb882a94b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.105867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742c006e980a48be88166beeb882a94b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.118260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742c006e980a48be88166beeb882a94b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.118929 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742c006e980a48be88166beeb882a94b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.125991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742c006e980a48be88166beeb882a94b'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.131951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1269/2611] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:53:31 2022] DELETE /identity/v3/users/742c006e980a48be88166beeb882a94b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:53:32.136471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:32.136935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:32.137048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:32.156009 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:32.157218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:32.206114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:32.216153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1343/2612] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:32.226533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:32.228042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:32.257445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:32.286499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab546d-5f6a-4fdd-b638-1a895549a650 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:32.290287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361be56-956e-4289-aa5e-c284d6f539bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:32.290952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361be56-956e-4289-aa5e-c284d6f539bb service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:32.292895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361be56-956e-4289-aa5e-c284d6f539bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:32.292895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361be56-956e-4289-aa5e-c284d6f539bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:32.300910 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361be56-956e-4289-aa5e-c284d6f539bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:32.302456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361be56-956e-4289-aa5e-c284d6f539bb service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:32.312393 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1270/2613] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:32.718388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:32.719911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:32.735096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e7642-2dd1-404a-a6f1-3e399e18aafe None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:32.739865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:32.740862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:32.741160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:32.741411 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] PATH_INFO: `/v3/projects/06b7b1a51344493c8bbf3f1e716423ab` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:32.742589 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b7b1a51344493c8bbf3f1e716423ab)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:32.745090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:32.849106 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b7b1a51344493c8bbf3f1e716423ab', 'request_id': 'req-ce946835-75b1-4865-ae38-8dc853dbf2e7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.855734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b7b1a51344493c8bbf3f1e716423ab', 'request_id': 'req-ce946835-75b1-4865-ae38-8dc853dbf2e7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.934211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b7b1a51344493c8bbf3f1e716423ab', 'request_id': 'req-ce946835-75b1-4865-ae38-8dc853dbf2e7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.945802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] The token cache is being invalidate because project 06b7b1a51344493c8bbf3f1e716423ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:53:32.946089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.951130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ce946835-75b1-4865-ae38-8dc853dbf2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:32.951130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1344/2614] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:53:32 2022] DELETE /identity/v3/projects/06b7b1a51344493c8bbf3f1e716423ab => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:32.953755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:32.954203 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:32.954306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:32.972077 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:32.973295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:33.037905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1271/2615] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:33.046251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.046613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.047008 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.066163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:33.067417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:33.075865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1345/2616] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:33.080144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.090047 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4a51-64d0-4500-bd2a-c2ba2f740ff3 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.098841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.098841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.098841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.098841 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.099258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:53:33.099258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.099258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.111154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1272/2617] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:53:33.115766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.126080 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f888223-671a-4e9a-8fe5-ba32b98fc8ec None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.130708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.131363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.131645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.131917 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.132715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.134572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.209765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1346/2618] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:53:33 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:33.214051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.224459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85fa10-764b-45ef-b50e-c8dcee47c4b5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.282637 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.283355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.283628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.283901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.284605 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.286547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.409008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1273/2619] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:53:33 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:33.415360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.424874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538883-49f9-4919-835f-dbec022998b2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.429431 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.430117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.430398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.430705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.431427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.433381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.444477 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1347/2620] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:33.448749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.458937 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faccd1-ce6f-466d-ad4b-9d43af3fccb8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.464119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e662-3441-4690-986e-2ce2dd4b58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.464781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e662-3441-4690-986e-2ce2dd4b58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.465065 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e662-3441-4690-986e-2ce2dd4b58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.465373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e662-3441-4690-986e-2ce2dd4b58c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.466266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e662-3441-4690-986e-2ce2dd4b58c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.468140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e662-3441-4690-986e-2ce2dd4b58c0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.478092 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1274/2621] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:33.483216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.493397 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90597c-4bc1-4c11-b06e-8971d62ae5d5 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.498223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.499143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.499424 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.499697 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] PATH_INFO: `/v3/projects/741508c05ef2498cb0c354ec80fdb5a6/users/0ba0c294efff4bc48ca479f747965fdb/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.514314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] RBAC: Authorizing `identity:create_grant(project_id=741508c05ef2498cb0c354ec80fdb5a6, user_id=0ba0c294efff4bc48ca479f747965fdb, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.517048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.592568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1348/2622] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:53:33 2022] PUT /identity/v3/projects/741508c05ef2498cb0c354ec80fdb5a6/users/0ba0c294efff4bc48ca479f747965fdb/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:33.603283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.609797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.609797 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.644576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] MFA Rules not processed for user `0ba0c294efff4bc48ca479f747965fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:33.644576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:33.659590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:33.707791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1275/2623] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:53:33.712081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.787355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55c9c-7479-43e8-aa8a-3bb02bb4496f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:33.792541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:33.793248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:33.793540 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:33.793825 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:33.794539 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:33.796520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:33.936721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1349/2624] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:53:33 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:33.940756 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:33.952233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64b4e-8418-42e9-8c2b-42b2347aefad None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.009447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.010729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.011074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.011555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.012254 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:34.014468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:34.144340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1276/2625] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:53:33 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:34.145478 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:34.152933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:34.159468 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988592e-2a9f-4362-b50e-b64ee0c7c997 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.164819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.165570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.165919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.166667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.167669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:34.169330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:34.184488 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1350/2626] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:34.191115 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:34.202876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7733ca7-816d-445e-96d3-840e2caaedeb admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.207859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.208750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.209084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.209365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] PATH_INFO: `/v3/projects/3a12b603823149bba36c0de1d3118e74/users/0f8cb4a985cf460f871c03f30cb13da0/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.242049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a12b603823149bba36c0de1d3118e74, user_id=0f8cb4a985cf460f871c03f30cb13da0, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:34.245527 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:34.357870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1277/2627] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:53:34 2022] PUT /identity/v3/projects/3a12b603823149bba36c0de1d3118e74/users/0f8cb4a985cf460f871c03f30cb13da0/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:34.362341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:34.374350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296908fd-7717-4cd7-a730-00d54c810d00 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.443253 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980df06-2538-4d5d-b4a1-5cd9aa6b8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.444025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980df06-2538-4d5d-b4a1-5cd9aa6b8f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.444316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980df06-2538-4d5d-b4a1-5cd9aa6b8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.444592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980df06-2538-4d5d-b4a1-5cd9aa6b8f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.445324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980df06-2538-4d5d-b4a1-5cd9aa6b8f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:34.447029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980df06-2538-4d5d-b4a1-5cd9aa6b8f46 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:34.458728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1351/2628] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:34.461497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:34.472593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5c676-4fd6-4401-8af4-97e18df2855f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.477274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.478160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.478439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.479288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] PATH_INFO: `/v3/projects/3a12b603823149bba36c0de1d3118e74/users/0f8cb4a985cf460f871c03f30cb13da0/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.481733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a12b603823149bba36c0de1d3118e74, user_id=0f8cb4a985cf460f871c03f30cb13da0, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:34.484403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:34.500795 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1278/2629] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:53:34 2022] PUT /identity/v3/projects/3a12b603823149bba36c0de1d3118e74/users/0f8cb4a985cf460f871c03f30cb13da0/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:34.507914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c03a-891b-4172-828d-92554290a697 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.508232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c03a-891b-4172-828d-92554290a697 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.508506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70c03a-891b-4172-828d-92554290a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.537614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-aa70c03a-891b-4172-828d-92554290a697 None None] MFA Rules not processed for user `0f8cb4a985cf460f871c03f30cb13da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:34.539003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-aa70c03a-891b-4172-828d-92554290a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:34.612063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1352/2630] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:53:34.624270 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:34.626194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:34.687645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4854a4-08f0-448b-8cb9-e41120da9cd3 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.691202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.691849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.692132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.692403 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:34.702747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:34.704239 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:34.715928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1279/2631] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:34.923903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c03a-891b-4172-828d-92554290a697 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:34.934264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70c03a-891b-4172-828d-92554290a697 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:34.944600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:34.944600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:34.944600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:34.944600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:35.002796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:35.007489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:35.013937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1353/2632] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:40.371660 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:40.373078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:40.394269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:40.437548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944978-46e5-4374-8d3d-68afcfda785e service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:40.441154 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:40.441794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:40.442076 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:40.442365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:40.444125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:40.508432 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:40.510337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:40.519933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1280/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:43.990850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:43.995786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:44.007152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e74960-4580-4d41-9316-7c0fbb932249 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:44.012279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:44.013192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:44.013457 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:44.013737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] PATH_INFO: `/v3/users/56083498939444d3b06f6282ed22d253` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:44.015133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56083498939444d3b06f6282ed22d253)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:44.017086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:44.022635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=100 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:44.215784 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56083498939444d3b06f6282ed22d253'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:44.287296 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56083498939444d3b06f6282ed22d253'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:44.287915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56083498939444d3b06f6282ed22d253'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:44.296722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56083498939444d3b06f6282ed22d253'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:44.311060 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c49c33c2-87aa-45fb-ab83-0c6f7048e194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56083498939444d3b06f6282ed22d253'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:44.317262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1354/2634] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:53:43 2022] DELETE /identity/v3/users/56083498939444d3b06f6282ed22d253 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:44.837352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:44.848844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6cfc5-6a2a-411e-9bd2-162a3b532440 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:44.906808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:44.907685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:44.907967 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:44.908258 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] PATH_INFO: `/v3/projects/9c2701c39e76474c96060130d8d47bcb` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:44.909451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2701c39e76474c96060130d8d47bcb)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:44.911576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:44.997558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2701c39e76474c96060130d8d47bcb', 'request_id': 'req-ffcb9f17-9d15-49de-b1b9-35985e259b73'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:45.003864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2701c39e76474c96060130d8d47bcb', 'request_id': 'req-ffcb9f17-9d15-49de-b1b9-35985e259b73'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:45.081451 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2701c39e76474c96060130d8d47bcb', 'request_id': 'req-ffcb9f17-9d15-49de-b1b9-35985e259b73'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:45.089035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:45.094189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] The token cache is being invalidate because project 9c2701c39e76474c96060130d8d47bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:53:45.094474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:45.095140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ffcb9f17-9d15-49de-b1b9-35985e259b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:53:45.096725 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1281/2635] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:53:44 2022] DELETE /identity/v3/projects/9c2701c39e76474c96060130d8d47bcb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:45.101800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.102263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.102370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.121236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:45.122474 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:45.181933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1355/2636] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:45.190439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.190764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.191049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.210768 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:45.211975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:45.220424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1282/2637] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:45.224635 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.234934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a66f7-9f99-4eb0-b98d-09d8a61865f0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:45.239780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:45.240545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.240861 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.241141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.241882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:53:45.242194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:45.243819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:45.256156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1356/2638] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:53:45.260888 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.270146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9a536-cdc3-4701-ae6d-19b11ed36440 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:45.274955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:45.275600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.276547 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.277032 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.278278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:45.280209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:45.357987 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1283/2639] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:53:45 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:53:45.362192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.372715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41e1f0-26c2-415b-9787-094429cc0be6 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:45.432679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:45.433469 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.433831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.434241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.435028 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:45.436999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:45.562941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:45.568190 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1357/2640] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:53:45 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:53:45.572524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.583281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7ff9a-db67-417f-abd3-4d8ead196595 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:45.587958 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:45.589233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.589513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.589790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.590526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:45.592436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:45.726616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1284/2641] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:53:45.730976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.741108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bf382-cc47-435e-b2a1-b970aef03fe4 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:45.749086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4da4b-42c7-4abc-b756-53f0511ba190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:45.749086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4da4b-42c7-4abc-b756-53f0511ba190 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.749086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4da4b-42c7-4abc-b756-53f0511ba190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.749086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4da4b-42c7-4abc-b756-53f0511ba190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.749506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4da4b-42c7-4abc-b756-53f0511ba190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:45.749609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4da4b-42c7-4abc-b756-53f0511ba190 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:45.759956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1358/2642] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:53:45.764859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.780765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47bff8-9f22-4e94-ab37-3628760db308 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:45.785878 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:45.786796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.787103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.787373 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] PATH_INFO: `/v3/projects/f3573c5fade84778a9dc304df2f8c9ff/users/8a443b587dc844d48b64aef7434f3f49/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.803064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3573c5fade84778a9dc304df2f8c9ff, user_id=8a443b587dc844d48b64aef7434f3f49, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:45.805679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:45.871055 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1285/2643] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:53:45 2022] PUT /identity/v3/projects/f3573c5fade84778a9dc304df2f8c9ff/users/8a443b587dc844d48b64aef7434f3f49/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:53:45.876101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730789ac-3f54-4b06-bc34-b29d3b988f2a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:45.876396 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730789ac-3f54-4b06-bc34-b29d3b988f2a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:45.876680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730789ac-3f54-4b06-bc34-b29d3b988f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:45.894653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-730789ac-3f54-4b06-bc34-b29d3b988f2a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:45.899348 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-730789ac-3f54-4b06-bc34-b29d3b988f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:45.958850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1359/2644] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:53:45.969426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:45.971186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:46.028642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeadc7-b0c0-489d-9cfa-71758fd6d664 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:46.032264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:46.032914 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:46.033202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:46.033479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:46.042788 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:46.045892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:46.054053 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1286/2645] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:51.660255 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe209f-33e1-4baf-a13d-ad974070c3ea None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:51.661205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe209f-33e1-4baf-a13d-ad974070c3ea None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:51.661696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe209f-33e1-4baf-a13d-ad974070c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:51.692669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-73fe209f-33e1-4baf-a13d-ad974070c3ea None None] MFA Rules not processed for user `8a443b587dc844d48b64aef7434f3f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:51.693913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-73fe209f-33e1-4baf-a13d-ad974070c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:51.799683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1360/2646] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:53:51.824191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:51.824191 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:51.913711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7d91-b7b4-49ba-8631-2d99b5c30119 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:51.921358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:51.921543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:51.921747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:51.922027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:51.932692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:51.934300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:51.944656 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1287/2647] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:53:54.638169 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:54.640359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:54.640359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:54.658308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] MFA Rules not processed for user `8a443b587dc844d48b64aef7434f3f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:53:54.659619 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:54.666780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1361/2648] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:53:59.077274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:53:59.089116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f3abb-2e41-4547-954c-e71ca1a640cb service nova] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:53:59.095424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:53:59.095424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:53:59.095794 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:53:59.095975 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:53:59.097802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:53:59.119405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:59.164360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:53:59.165779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:53:59.175486 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1288/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:04.651642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=67 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:06.607732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:06.617343 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4061-a524-4ed3-a91f-3a5e9d288acd None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:06.620860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:06.621502 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:06.621788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:06.622067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:06.624534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:06.636203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:06.637623 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00fe15-53f3-442e-b5b4-6f840dd5c8e4 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:06.648164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1362/2650] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:09.280711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=18 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:13.628097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:13.629655 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:13.735414 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d84762-dc6b-4e9d-ac85-a116f68f67c7 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:13.740212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:13.741086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:13.741365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:13.741633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] PATH_INFO: `/v3/users/0ba0c294efff4bc48ca479f747965fdb` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:13.742886 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba0c294efff4bc48ca479f747965fdb)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:13.744791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:13.916591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba0c294efff4bc48ca479f747965fdb'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.022356 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba0c294efff4bc48ca479f747965fdb'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.041301 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba0c294efff4bc48ca479f747965fdb'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.042553 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba0c294efff4bc48ca479f747965fdb'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.053489 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba0c294efff4bc48ca479f747965fdb'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.059787 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1289/2651] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:13 2022] DELETE /identity/v3/users/0ba0c294efff4bc48ca479f747965fdb => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:14.065207 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:14.065669 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:14.065757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:14.093654 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:14.094978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:14.158811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1363/2652] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:14.170672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:14.174716 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:14.263791 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45680317-5a8e-40db-be83-a17ba49f2e56 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:14.267702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:14.268360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:14.268644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:14.268921 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:14.278416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:14.280402 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:14.285022 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:14.292084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1290/2653] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:14.618451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:14.620277 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:14.633738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168e53-bd43-4e13-b8b3-f67022cb0d47 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:14.639092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:14.642162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:14.642162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:14.642162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] PATH_INFO: `/v3/users/aa44dda2c1a8450a9e0b3e1176de5686` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:14.642162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa44dda2c1a8450a9e0b3e1176de5686)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:14.643842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:14.916666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa44dda2c1a8450a9e0b3e1176de5686'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.939552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:14.941088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:14.960817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606a2c-1467-446c-845e-fe29b4a1c322 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:14.966088 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:14.967209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:14.967497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:14.967940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] PATH_INFO: `/v3/projects/741508c05ef2498cb0c354ec80fdb5a6` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:14.969249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] RBAC: Authorizing `identity:delete_project(project_id=741508c05ef2498cb0c354ec80fdb5a6)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:14.971247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:14.988395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa44dda2c1a8450a9e0b3e1176de5686'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.989016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa44dda2c1a8450a9e0b3e1176de5686'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:14.996767 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa44dda2c1a8450a9e0b3e1176de5686'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.010013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa44dda2c1a8450a9e0b3e1176de5686'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.017775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1364/2654] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:14 2022] DELETE /identity/v3/users/aa44dda2c1a8450a9e0b3e1176de5686 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:15.126097 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741508c05ef2498cb0c354ec80fdb5a6', 'request_id': 'req-f0367c47-cf7d-42d5-930e-a0a42958061a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.132453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741508c05ef2498cb0c354ec80fdb5a6', 'request_id': 'req-f0367c47-cf7d-42d5-930e-a0a42958061a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.228368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741508c05ef2498cb0c354ec80fdb5a6', 'request_id': 'req-f0367c47-cf7d-42d5-930e-a0a42958061a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.240415 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] The token cache is being invalidate because project 741508c05ef2498cb0c354ec80fdb5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:15.240704 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.241344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.242949 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1291/2655] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:14 2022] DELETE /identity/v3/projects/741508c05ef2498cb0c354ec80fdb5a6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:15.249185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:15.249185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:15.275749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:15.288146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:15.318627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:15.330896 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57802-dc44-40b3-ae15-b26c21cd22c0 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:15.350934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367c47-cf7d-42d5-930e-a0a42958061a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:15.355593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:15.356454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:15.356738 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:15.357014 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] PATH_INFO: `/v3/projects/63ca0d9866c946cfa7368f14dd428b6d` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:15.358963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ca0d9866c946cfa7368f14dd428b6d)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:15.360870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:15.396545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:15.397419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:15.397704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:15.397984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] PATH_INFO: `/v3/users/0f8cb4a985cf460f871c03f30cb13da0` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:15.399281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8cb4a985cf460f871c03f30cb13da0)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:15.401284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:15.619817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ca0d9866c946cfa7368f14dd428b6d', 'request_id': 'req-36623e99-5f44-4714-974b-d2c1a0c7edf3'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.620918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8cb4a985cf460f871c03f30cb13da0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.626015 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ca0d9866c946cfa7368f14dd428b6d', 'request_id': 'req-36623e99-5f44-4714-974b-d2c1a0c7edf3'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.679801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8cb4a985cf460f871c03f30cb13da0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.680415 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8cb4a985cf460f871c03f30cb13da0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.689273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8cb4a985cf460f871c03f30cb13da0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.702433 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8cb4a985cf460f871c03f30cb13da0'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.708611 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1365/2656] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:15 2022] DELETE /identity/v3/users/0f8cb4a985cf460f871c03f30cb13da0 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:15.730969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ca0d9866c946cfa7368f14dd428b6d', 'request_id': 'req-36623e99-5f44-4714-974b-d2c1a0c7edf3'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.742866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] The token cache is being invalidate because project 63ca0d9866c946cfa7368f14dd428b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:15.743202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.743851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:15.745518 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1292/2657] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:15 2022] DELETE /identity/v3/projects/63ca0d9866c946cfa7368f14dd428b6d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:15.750368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:15.751860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:15.827129 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608032d2-2b90-4181-a68f-5c73f60556c2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:15.832512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:15.833446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:15.833733 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:15.834013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] PATH_INFO: `/v3/users/0cabf5554f0a4ce68fd84f211ca6e9af` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:15.835394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cabf5554f0a4ce68fd84f211ca6e9af)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:15.837345 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:15.860769 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:16.073884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cabf5554f0a4ce68fd84f211ca6e9af'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.144178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:16.145654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:16.155382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cabf5554f0a4ce68fd84f211ca6e9af'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.155382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cabf5554f0a4ce68fd84f211ca6e9af'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.160346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:16.165301 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cabf5554f0a4ce68fd84f211ca6e9af'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.196162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cabf5554f0a4ce68fd84f211ca6e9af'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.197830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1366/2658] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:15 2022] DELETE /identity/v3/users/0cabf5554f0a4ce68fd84f211ca6e9af => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:16.226612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36623e99-5f44-4714-974b-d2c1a0c7edf3 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:16.285838 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:16.286621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:16.286933 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:16.287205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] PATH_INFO: `/v3/projects/3a12b603823149bba36c0de1d3118e74` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:16.288468 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a12b603823149bba36c0de1d3118e74)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:16.290360 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:16.411747 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a12b603823149bba36c0de1d3118e74', 'request_id': 'req-f3903fd5-da6d-412a-96cb-63acc597d855'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.418215 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a12b603823149bba36c0de1d3118e74', 'request_id': 'req-f3903fd5-da6d-412a-96cb-63acc597d855'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.596056 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:16.604974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:16.611712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6557-6e9a-4077-8d80-c0684a90e4aa admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:16.668960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:16.670423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:16.670913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:16.671200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] PATH_INFO: `/v3/projects/9ad51d352c76478a906873ff870aec90` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:16.672600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad51d352c76478a906873ff870aec90)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:16.674531 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:16.703265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a12b603823149bba36c0de1d3118e74', 'request_id': 'req-f3903fd5-da6d-412a-96cb-63acc597d855'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.714595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] The token cache is being invalidate because project 3a12b603823149bba36c0de1d3118e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:16.714909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.715560 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f3903fd5-da6d-412a-96cb-63acc597d855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.717722 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1293/2659] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:16 2022] DELETE /identity/v3/projects/3a12b603823149bba36c0de1d3118e74 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:16.722416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529ebc-5878-4e0c-9abc-48221ca7031b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:16.722734 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529ebc-5878-4e0c-9abc-48221ca7031b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:16.723020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529ebc-5878-4e0c-9abc-48221ca7031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:16.768524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d5529ebc-5878-4e0c-9abc-48221ca7031b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:16.769755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d5529ebc-5878-4e0c-9abc-48221ca7031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:16.777806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1294/2660] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:16.786211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:16.786339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:16.786621 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:16.804670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:16.806368 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:16.814083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1295/2661] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:16.818337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:16.828411 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97aab8-f3f3-47ec-9427-0255df5e54a6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:16.833482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:16.834269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:16.834558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:16.834904 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:16.835643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:16.835957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:16.837591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:16.851287 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1296/2662] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 10:54:16.855458 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:16.859592 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad51d352c76478a906873ff870aec90', 'request_id': 'req-a2f64419-51f8-491c-b48b-ddf3f760c163'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.865350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fba8-3990-4674-bbb3-c66a6446626a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:16.866282 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad51d352c76478a906873ff870aec90', 'request_id': 'req-a2f64419-51f8-491c-b48b-ddf3f760c163'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.921354 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:16.922020 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:16.922306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:16.922584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:16.923302 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:16.925266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:16.959193 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad51d352c76478a906873ff870aec90', 'request_id': 'req-a2f64419-51f8-491c-b48b-ddf3f760c163'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.971407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] The token cache is being invalidate because project 9ad51d352c76478a906873ff870aec90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:16.971789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.972420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:16.974027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1367/2663] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:16 2022] DELETE /identity/v3/projects/9ad51d352c76478a906873ff870aec90 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:17.056578 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1297/2664] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:16 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:17.057973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.059711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:17.073881 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f64419-51f8-491c-b48b-ddf3f760c163 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.103690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:17.136850 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.137564 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.137855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.138137 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.139515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.141761 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.155408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:17.262819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1368/2665] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:17 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:17.267827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.278052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b64ac6-c9cd-4ebe-b314-574ef26071f8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.282785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.283445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.283723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.284175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.284898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.286473 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.296464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1298/2666] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:54:17.300440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.311003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301193-8739-4a46-a0eb-63e8b9a55d7d admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.315980 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852072f-b9bf-485d-ae8e-e868c0258f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.316647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852072f-b9bf-485d-ae8e-e868c0258f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.316960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852072f-b9bf-485d-ae8e-e868c0258f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.317251 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852072f-b9bf-485d-ae8e-e868c0258f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.318016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852072f-b9bf-485d-ae8e-e868c0258f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.319696 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852072f-b9bf-485d-ae8e-e868c0258f81 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.330386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1369/2667] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:17.334636 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.345509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4687c9-f407-499e-bb7e-9fb589ed2f2f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.350049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.350989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.351269 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.351542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] PATH_INFO: `/v3/projects/622d5ea9d5c547769d68fa64d0ea5483/users/090372560f1a45d4887f96dd587cac21/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.366241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] RBAC: Authorizing `identity:create_grant(project_id=622d5ea9d5c547769d68fa64d0ea5483, user_id=090372560f1a45d4887f96dd587cac21, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.368843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.473733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1299/2668] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:17 2022] PUT /identity/v3/projects/622d5ea9d5c547769d68fa64d0ea5483/users/090372560f1a45d4887f96dd587cac21/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:17.485798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.486132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.486423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.513512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] MFA Rules not processed for user `090372560f1a45d4887f96dd587cac21`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:17.514931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:17.580515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1370/2669] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:17.584991 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.645827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaebe0-aefc-4352-a1a9-c2171637497a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.650593 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.651294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.651581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.651859 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.652563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.654842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.766105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1300/2670] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:17 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:17.770216 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.781404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3a15b-a9ca-4a85-852a-ee7d6bcf3145 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.837950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.838916 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.839203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.839481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.840176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.842705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.954591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1371/2671] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:17 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:17.958936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:17.970453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79901d7-c80a-428e-8e08-02526832d5f4 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:17.975176 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:17.975837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:17.976126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:17.976419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:17.977133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:17.978786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:17.990868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1301/2672] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:54:17.995018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:18.006185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855e038-44e7-4e77-8d18-07efc2c0742b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:18.010899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:18.025176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:18.025176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:18.025176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] PATH_INFO: `/v3/projects/a467cd6e3fe747cc98325577bdafd70b/users/e19f3f33b10543ce8bfe5af60689ac60/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:18.027481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a467cd6e3fe747cc98325577bdafd70b, user_id=e19f3f33b10543ce8bfe5af60689ac60, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:18.030865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:18.136484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1372/2673] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:17 2022] PUT /identity/v3/projects/a467cd6e3fe747cc98325577bdafd70b/users/e19f3f33b10543ce8bfe5af60689ac60/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:18.140666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:18.150715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8276ed-2d2e-4582-bf1f-815757f06285 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:18.169313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:18.207037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececd37-2018-4bbd-8577-b6ff6fd1047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:18.207645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececd37-2018-4bbd-8577-b6ff6fd1047e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:18.207928 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececd37-2018-4bbd-8577-b6ff6fd1047e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:18.208202 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececd37-2018-4bbd-8577-b6ff6fd1047e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:18.208927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececd37-2018-4bbd-8577-b6ff6fd1047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:18.210651 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececd37-2018-4bbd-8577-b6ff6fd1047e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:18.221754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1302/2674] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:18.225887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:18.231370 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:18.236803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189836c-f4a5-4709-8d10-d2754359fb8c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:18.241732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:18.242614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:18.242957 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:18.243231 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] PATH_INFO: `/v3/projects/a467cd6e3fe747cc98325577bdafd70b/users/e19f3f33b10543ce8bfe5af60689ac60/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:18.245284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a467cd6e3fe747cc98325577bdafd70b, user_id=e19f3f33b10543ce8bfe5af60689ac60, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:18.247964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:18.258223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1373/2675] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:18 2022] PUT /identity/v3/projects/a467cd6e3fe747cc98325577bdafd70b/users/e19f3f33b10543ce8bfe5af60689ac60/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:18.268941 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:18.269307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:18.269591 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:18.296073 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] MFA Rules not processed for user `e19f3f33b10543ce8bfe5af60689ac60`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:18.297288 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:18.365729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1303/2676] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:18.376663 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:18.378362 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:18.438682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f631b89-73bd-470b-ba1c-7812e7d5dfb7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:18.442365 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba41fa-cb53-4860-89a3-2ef6bab3941d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:18.443045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba41fa-cb53-4860-89a3-2ef6bab3941d service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:18.443352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba41fa-cb53-4860-89a3-2ef6bab3941d service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:18.443614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba41fa-cb53-4860-89a3-2ef6bab3941d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:18.452946 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba41fa-cb53-4860-89a3-2ef6bab3941d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:18.454389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba41fa-cb53-4860-89a3-2ef6bab3941d service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:18.464167 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1374/2677] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:21.128519 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:21.188858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9423ca1-a464-4c38-9729-2fbd9f6d7223 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:21.193548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:21.194419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:21.194713 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:21.195007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] PATH_INFO: `/v3/users/090372560f1a45d4887f96dd587cac21` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:21.196212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090372560f1a45d4887f96dd587cac21)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:21.198193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:21.411691 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:21.413189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090372560f1a45d4887f96dd587cac21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:21.478838 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090372560f1a45d4887f96dd587cac21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:21.491352 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090372560f1a45d4887f96dd587cac21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:21.491989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090372560f1a45d4887f96dd587cac21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:21.498930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090372560f1a45d4887f96dd587cac21'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:21.504870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1304/2678] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:21 2022] DELETE /identity/v3/users/090372560f1a45d4887f96dd587cac21 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:21.509529 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:21.510000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:21.510096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:21.527412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:21.528545 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:21.587581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1375/2679] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:21.597498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:21.598948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:21.656535 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f851b2-0089-4b86-8bc2-94231a158ea7 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:21.660157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:21.660800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:21.661083 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:21.661357 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:21.670319 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:21.671863 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:21.681220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1305/2680] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:22.080420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:22.083419 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:22.096271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d907-5be9-47ea-87ba-e0360736e693 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:22.101049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:22.102003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:22.102347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:22.102855 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] PATH_INFO: `/v3/projects/622d5ea9d5c547769d68fa64d0ea5483` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:22.104188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622d5ea9d5c547769d68fa64d0ea5483)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:22.106049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:22.222753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622d5ea9d5c547769d68fa64d0ea5483', 'request_id': 'req-3755e2e3-ddf1-49b7-895b-97a704e78f41'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.228834 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622d5ea9d5c547769d68fa64d0ea5483', 'request_id': 'req-3755e2e3-ddf1-49b7-895b-97a704e78f41'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.353643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622d5ea9d5c547769d68fa64d0ea5483', 'request_id': 'req-3755e2e3-ddf1-49b7-895b-97a704e78f41'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.365394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] The token cache is being invalidate because project 622d5ea9d5c547769d68fa64d0ea5483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:22.365682 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.366339 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.367920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1376/2681] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:22 2022] DELETE /identity/v3/projects/622d5ea9d5c547769d68fa64d0ea5483 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:22.371923 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:22.381853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422c9c-9221-4f2c-a5ca-b48f08f1ab97 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:22.439247 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:22.440124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:22.440412 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:22.440688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] PATH_INFO: `/v3/users/e19f3f33b10543ce8bfe5af60689ac60` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:22.441891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19f3f33b10543ce8bfe5af60689ac60)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:22.443895 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:22.630134 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19f3f33b10543ce8bfe5af60689ac60'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.712896 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19f3f33b10543ce8bfe5af60689ac60'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.724306 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:22.726494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19f3f33b10543ce8bfe5af60689ac60'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.727226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19f3f33b10543ce8bfe5af60689ac60'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.735113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-85df0dcd-8a9b-4008-a803-1ea29a6239dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19f3f33b10543ce8bfe5af60689ac60'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:22.741004 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1306/2682] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:22 2022] DELETE /identity/v3/users/e19f3f33b10543ce8bfe5af60689ac60 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:23.166338 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.167914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:23.183593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755e2e3-ddf1-49b7-895b-97a704e78f41 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.198350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:23.243356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.244225 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.244513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.244792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] PATH_INFO: `/v3/projects/a467cd6e3fe747cc98325577bdafd70b` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.245991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a467cd6e3fe747cc98325577bdafd70b)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.247956 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.324815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a467cd6e3fe747cc98325577bdafd70b', 'request_id': 'req-c9734890-be7d-4b25-9ded-1c2f1826c099'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:23.331039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a467cd6e3fe747cc98325577bdafd70b', 'request_id': 'req-c9734890-be7d-4b25-9ded-1c2f1826c099'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:23.376058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a467cd6e3fe747cc98325577bdafd70b', 'request_id': 'req-c9734890-be7d-4b25-9ded-1c2f1826c099'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:23.386449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] The token cache is being invalidate because project a467cd6e3fe747cc98325577bdafd70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:23.386768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:23.387420 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c9734890-be7d-4b25-9ded-1c2f1826c099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:23.388976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1377/2683] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:23 2022] DELETE /identity/v3/projects/a467cd6e3fe747cc98325577bdafd70b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:23.394613 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.395107 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.395218 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.413644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:23.414868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:23.474664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1307/2684] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:23.483414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.483709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.484015 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.502170 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:23.503430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:23.511482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1378/2685] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:23.516308 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.525729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39b93-7540-4ec4-bcce-037035327b0c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.531044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.531690 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.531971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.532243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.532968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:23.533273 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.534865 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.546575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1308/2686] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:54:23.550372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.559578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f251b3d-38de-48f0-b596-71688752cf30 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.564422 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.565071 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.565356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.565636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.566331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.568279 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.664548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1379/2687] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:23 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:23.668801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.679376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f63bc-15cc-49ec-a344-010856ee3428 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.735334 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.735924 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.736211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.736495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.737193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.739201 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.822358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1309/2688] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:23 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:23.826481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.837666 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4bc04-79c9-4e04-bb16-8cccf9d68fb1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.842671 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.843355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.843638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.843913 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.844643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.846278 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.856719 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1380/2689] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:23.860623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.870743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeb8ac-54c7-42af-96c9-9350d1c4e794 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.876062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2629-1fea-435e-9b9d-bb9e60776f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.876723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2629-1fea-435e-9b9d-bb9e60776f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.877008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2629-1fea-435e-9b9d-bb9e60776f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.877285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2629-1fea-435e-9b9d-bb9e60776f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.878017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d2629-1fea-435e-9b9d-bb9e60776f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.879648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d2629-1fea-435e-9b9d-bb9e60776f13 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.892060 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1310/2690] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:23.896242 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:23.906486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebda907-6d17-4a93-8f62-0fe7be2a77fa admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:23.911073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:23.911941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:23.912226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:23.912508 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] PATH_INFO: `/v3/projects/b4ff00adfebb4fe88efc696258e38766/users/ed585a7d21c84d78bb7324c0484aed10/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:23.926950 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ff00adfebb4fe88efc696258e38766, user_id=ed585a7d21c84d78bb7324c0484aed10, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:23.929606 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:23.999026 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1381/2691] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:23 2022] PUT /identity/v3/projects/b4ff00adfebb4fe88efc696258e38766/users/ed585a7d21c84d78bb7324c0484aed10/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:24.009231 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.009525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.009806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.036617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] MFA Rules not processed for user `ed585a7d21c84d78bb7324c0484aed10`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:24.037835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:24.077765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:24.101064 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1311/2692] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:24.105915 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.151248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:24.168486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036d7c-fec3-43bb-b8dc-2a9e0fbc0234 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.173836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.181023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.181023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.181023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] PATH_INFO: `/v3/projects` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.181023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.181023 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.234835 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1382/2693] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:24 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:24.238891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.250482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6a00-3e2f-4386-8785-ab337555e4f2 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.305870 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.306573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.306885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.307160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] PATH_INFO: `/v3/users` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.307857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.309876 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.364590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1312/2694] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:24 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:24.368524 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.379561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a019-56f5-4b55-9ee2-d10b52ccc19a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.384182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.384840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.385124 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.385398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.386166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.387809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.398542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1383/2695] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:24.403049 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.413255 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6e863-3d71-444a-bd13-d058e0d5e285 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.418017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.419137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.419425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.419706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] PATH_INFO: `/v3/projects/6c7fa65b2b0c45d986a320d040aff197/users/9203667cd4ee49ac8fc29dacf9ad154f/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.435103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7fa65b2b0c45d986a320d040aff197, user_id=9203667cd4ee49ac8fc29dacf9ad154f, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.438455 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.507837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1313/2696] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:24 2022] PUT /identity/v3/projects/6c7fa65b2b0c45d986a320d040aff197/users/9203667cd4ee49ac8fc29dacf9ad154f/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:24.511806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.522119 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238af11-21f3-4119-8102-e1f61a825896 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.577429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c0ee3-3a16-4660-a287-bd295db5fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.578094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c0ee3-3a16-4660-a287-bd295db5fba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.578380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c0ee3-3a16-4660-a287-bd295db5fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.578659 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c0ee3-3a16-4660-a287-bd295db5fba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.579417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c0ee3-3a16-4660-a287-bd295db5fba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.581007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c0ee3-3a16-4660-a287-bd295db5fba6 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.590744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1384/2697] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:24.595616 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.605800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbfa37-aac6-486c-b39d-f37d98c9dfd5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.611314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.612193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.612474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.612746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] PATH_INFO: `/v3/projects/6c7fa65b2b0c45d986a320d040aff197/users/9203667cd4ee49ac8fc29dacf9ad154f/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.614763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7fa65b2b0c45d986a320d040aff197, user_id=9203667cd4ee49ac8fc29dacf9ad154f, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.617434 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.627951 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1314/2698] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:24 2022] PUT /identity/v3/projects/6c7fa65b2b0c45d986a320d040aff197/users/9203667cd4ee49ac8fc29dacf9ad154f/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:24.638183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.638482 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.638792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.664894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] MFA Rules not processed for user `9203667cd4ee49ac8fc29dacf9ad154f`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:24.666097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:24.734481 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1385/2699] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:24.745510 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.747322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:24.804824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71494e-7607-47d3-bd36-2963a98be7e0 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.808496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc49c4c-5ebf-428f-b655-401165378eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.809139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49c4c-5ebf-428f-b655-401165378eba service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.809427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49c4c-5ebf-428f-b655-401165378eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.810379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49c4c-5ebf-428f-b655-401165378eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.824031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc49c4c-5ebf-428f-b655-401165378eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.825454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc49c4c-5ebf-428f-b655-401165378eba service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:24.835571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1315/2700] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:24.863932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:24.903386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:24.924400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa132890-6ecd-475e-b4b4-20bb5bf315b7 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:24.929093 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:24.930064 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:24.930241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:24.930519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] PATH_INFO: `/v3/users/ed585a7d21c84d78bb7324c0484aed10` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:24.931757 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed585a7d21c84d78bb7324c0484aed10)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:24.933673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.115134 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed585a7d21c84d78bb7324c0484aed10'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.158581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed585a7d21c84d78bb7324c0484aed10'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.159241 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed585a7d21c84d78bb7324c0484aed10'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.166493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed585a7d21c84d78bb7324c0484aed10'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.179001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed585a7d21c84d78bb7324c0484aed10'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.185045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1386/2701] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:24 2022] DELETE /identity/v3/users/ed585a7d21c84d78bb7324c0484aed10 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:25.189620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.189915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.190195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.207945 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:25.209160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.239749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:25.268874 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1316/2702] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:25.278865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.282122 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.338899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db45273-a6e1-407f-8a63-e3b5722e4ca8 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.342565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.343236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.343520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.343796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.352748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.354194 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.363981 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1387/2703] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:25.708882 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.710323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:25.722483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bb86d-890c-4d46-bb73-27467f48ae07 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.727133 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.727998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.728278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.728576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] PATH_INFO: `/v3/projects/b4ff00adfebb4fe88efc696258e38766` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.729749 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ff00adfebb4fe88efc696258e38766)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.731683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.827784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ff00adfebb4fe88efc696258e38766', 'request_id': 'req-6d91077a-43db-43ef-974f-81c1de4c9ca7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.833938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ff00adfebb4fe88efc696258e38766', 'request_id': 'req-6d91077a-43db-43ef-974f-81c1de4c9ca7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.901401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ff00adfebb4fe88efc696258e38766', 'request_id': 'req-6d91077a-43db-43ef-974f-81c1de4c9ca7'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.912316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] The token cache is being invalidate because project b4ff00adfebb4fe88efc696258e38766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:25.912612 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.913243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:25.914802 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1317/2704] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:25 2022] DELETE /identity/v3/projects/b4ff00adfebb4fe88efc696258e38766 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:25.919014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:25.929462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d4f0-b181-48bb-8286-b2a825631d2b service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:25.986904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:25.987695 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:25.987977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:25.988247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] PATH_INFO: `/v3/users/9203667cd4ee49ac8fc29dacf9ad154f` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:25.989462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9203667cd4ee49ac8fc29dacf9ad154f)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:25.991412 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:25.992865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:26.172298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9203667cd4ee49ac8fc29dacf9ad154f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.267371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9203667cd4ee49ac8fc29dacf9ad154f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.268007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9203667cd4ee49ac8fc29dacf9ad154f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.275562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9203667cd4ee49ac8fc29dacf9ad154f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.288218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-a53b3610-7c4b-4fc7-88a6-46cfe6b5f7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9203667cd4ee49ac8fc29dacf9ad154f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.294298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1388/2705] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:25 2022] DELETE /identity/v3/users/9203667cd4ee49ac8fc29dacf9ad154f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:26.714832 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:26.716265 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:26.730243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91077a-43db-43ef-974f-81c1de4c9ca7 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:26.788460 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:26.789374 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.789653 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.789927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] PATH_INFO: `/v3/projects/6c7fa65b2b0c45d986a320d040aff197` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:26.791157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7fa65b2b0c45d986a320d040aff197)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:26.793079 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:26.902338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7fa65b2b0c45d986a320d040aff197', 'request_id': 'req-0ba92d50-2908-47e8-9c31-4e6967f47143'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.908781 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7fa65b2b0c45d986a320d040aff197', 'request_id': 'req-0ba92d50-2908-47e8-9c31-4e6967f47143'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.964603 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7fa65b2b0c45d986a320d040aff197', 'request_id': 'req-0ba92d50-2908-47e8-9c31-4e6967f47143'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.965906 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:26.975705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] The token cache is being invalidate because project 6c7fa65b2b0c45d986a320d040aff197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:26.976105 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.976723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0ba92d50-2908-47e8-9c31-4e6967f47143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:26.978227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1318/2706] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:26 2022] DELETE /identity/v3/projects/6c7fa65b2b0c45d986a320d040aff197 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:26.983375 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:26.983670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:26.983983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.002627 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:27.003914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:27.063118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1389/2707] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:27.071821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.072111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.072399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.091724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:27.093316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:27.101045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1319/2708] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:27.105226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.115198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea074-af66-4893-aa03-3d6e24a3a85c None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.119892 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.120551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.120843 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.121125 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.121856 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:27.122168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.124347 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.135891 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1390/2709] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:54:27.140682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.149669 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539abaef-5a4c-4e0a-bdea-e637990f1667 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.154394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.155120 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.155400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.155676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.156371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.158243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.269185 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1320/2710] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:27.273749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.284561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49e7d-dab1-48ea-ad43-dfae7c3de113 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.342407 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.343107 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.343395 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.343698 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.344385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.346355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.355730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:27.427944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1391/2711] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:27.432212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.443986 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca7f18-a123-4fd8-a5cf-b8ccda42cfdd admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.448915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.449595 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.449881 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.450158 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.450940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.453037 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.463883 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1321/2712] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:27.468013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.478228 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296728f-23ca-44b9-8144-28906303ad7c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.483649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15e6f3-ae50-4613-aa1a-10223f60407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.484318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e6f3-ae50-4613-aa1a-10223f60407e admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.484604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e6f3-ae50-4613-aa1a-10223f60407e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.484882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e6f3-ae50-4613-aa1a-10223f60407e admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.485651 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15e6f3-ae50-4613-aa1a-10223f60407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.487280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15e6f3-ae50-4613-aa1a-10223f60407e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.498087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1392/2713] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:27.502866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.512765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe541a5-2eb5-40b8-be95-daa8c103d3af admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.517673 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.518583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.518899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.519173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] PATH_INFO: `/v3/projects/c09f231a112543c58e71637c79e9c12d/users/1dfddaa69a9644f89320b6bc1f67c095/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.534198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09f231a112543c58e71637c79e9c12d, user_id=1dfddaa69a9644f89320b6bc1f67c095, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.536844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.615974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1322/2714] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:27 2022] PUT /identity/v3/projects/c09f231a112543c58e71637c79e9c12d/users/1dfddaa69a9644f89320b6bc1f67c095/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:27.626989 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.627283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.627563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.653955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] MFA Rules not processed for user `1dfddaa69a9644f89320b6bc1f67c095`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:27.655993 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:27.720254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1393/2715] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:27.724680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.785344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41370983-9897-4d44-bb62-b44307df42c4 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.789922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.790576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.790887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.791162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.791858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.793745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:27.873758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1323/2716] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:27.877906 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:27.888703 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997641c-fcea-4881-b7a6-9acd1461a6dd None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:27.944805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:27.945484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:27.945770 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:27.946048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:27.946780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:27.948739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.022349 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1394/2717] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:27 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:28.026233 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.037387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629982-f254-40b1-a251-571d60cc497c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.042155 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.042862 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.043196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.043447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.044212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.045963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.056800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1324/2718] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:28.060907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.071135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cbfc6-3077-4feb-b6a1-a513494a5902 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.075888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26604fd-db92-4953-8591-174dc024ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.076550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26604fd-db92-4953-8591-174dc024ab8c admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.076832 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26604fd-db92-4953-8591-174dc024ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.077716 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26604fd-db92-4953-8591-174dc024ab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.078446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26604fd-db92-4953-8591-174dc024ab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.080075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26604fd-db92-4953-8591-174dc024ab8c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.090344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1395/2719] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:28.095103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.105012 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e5a18-13d4-4d1e-992e-52bf437ac3a7 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.116520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.116520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.116520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.116520 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] PATH_INFO: `/v3/projects/e4b7bed93c41400ca73df041cd2297e2/users/30083a67f22745f7abdd4fe5cf8e2591/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.125969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b7bed93c41400ca73df041cd2297e2, user_id=30083a67f22745f7abdd4fe5cf8e2591, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.128626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.192930 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1325/2720] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:28 2022] PUT /identity/v3/projects/e4b7bed93c41400ca73df041cd2297e2/users/30083a67f22745f7abdd4fe5cf8e2591/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:28.204226 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.204517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.204798 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.233340 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] MFA Rules not processed for user `30083a67f22745f7abdd4fe5cf8e2591`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:28.234624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:28.277310 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:28.299869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1396/2721] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:28.304592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.345404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:28.367430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459fb4-3de0-4c6e-8d3d-98fee1808188 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.372638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.373293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.373576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.373915 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.374659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.376554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.456948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1326/2722] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:28 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:28.461237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.473147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904ae65-ea62-480e-8d4c-91be5f8514d6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.527735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.528337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.528624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.528901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.529600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.532153 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.593141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1397/2723] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:28 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:28.597162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.607577 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0c14-8e2c-4cb0-9106-bf8d4e61ab56 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.612990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.613680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.613960 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.614234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.615000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.616761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.627563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1327/2724] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:28.631649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.642288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050cba6-78ed-445d-909e-f02eae66c757 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.646964 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.647852 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.648166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.648461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] PATH_INFO: `/v3/projects/68b1951b0b9a4e7190bfeedb5de7ad15/users/44a2fcc5fa26423690f2771f03e30e08/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.663830 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b1951b0b9a4e7190bfeedb5de7ad15, user_id=44a2fcc5fa26423690f2771f03e30e08, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.666514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.735645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1398/2725] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:28 2022] PUT /identity/v3/projects/68b1951b0b9a4e7190bfeedb5de7ad15/users/44a2fcc5fa26423690f2771f03e30e08/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:28.739542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.749339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d83074-2848-4268-b329-3476d0431fb3 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.805569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26a8b8-e827-435b-9d81-08f44a07f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.806236 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26a8b8-e827-435b-9d81-08f44a07f04a admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.806521 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26a8b8-e827-435b-9d81-08f44a07f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.806828 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26a8b8-e827-435b-9d81-08f44a07f04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.807552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26a8b8-e827-435b-9d81-08f44a07f04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.809143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26a8b8-e827-435b-9d81-08f44a07f04a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.818681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1328/2726] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:28.822817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:28.833918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a87e43-38b5-468a-bf9f-1acefe65f047 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:28.838801 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:28.839677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.839962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.840237 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] PATH_INFO: `/v3/projects/68b1951b0b9a4e7190bfeedb5de7ad15/users/44a2fcc5fa26423690f2771f03e30e08/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.842214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b1951b0b9a4e7190bfeedb5de7ad15, user_id=44a2fcc5fa26423690f2771f03e30e08, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:28.845724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:28.855796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1399/2727] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:28 2022] PUT /identity/v3/projects/68b1951b0b9a4e7190bfeedb5de7ad15/users/44a2fcc5fa26423690f2771f03e30e08/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:28.920463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:28.920801 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:28.921221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:28.947297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] MFA Rules not processed for user `44a2fcc5fa26423690f2771f03e30e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:28.948500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.016209 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1329/2728] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:29.027181 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.028859 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.087202 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a337721-933c-4512-a8be-5ec4906cd921 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.091166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.091817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.092097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.092372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.101417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.102872 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.112593 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1400/2729] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:29.200528 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:29.202622 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:29.215323 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5be240-e5e2-4c23-a31d-8c6881b779b1 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:29.219127 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3c1e6-b939-4487-824c-e496e2ac770e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:29.219769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c1e6-b939-4487-824c-e496e2ac770e service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:29.220149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c1e6-b939-4487-824c-e496e2ac770e service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:29.220427 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c1e6-b939-4487-824c-e496e2ac770e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:29.250242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:29.280440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3c1e6-b939-4487-824c-e496e2ac770e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:29.281880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3c1e6-b939-4487-824c-e496e2ac770e service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:29.290868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1330/2730] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:33.029620 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:33.071020 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:33.092714 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f8bd-206f-4c01-a31b-1421f804d841 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:33.097919 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:33.098810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:33.099094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:33.099372 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] PATH_INFO: `/v3/users/1dfddaa69a9644f89320b6bc1f67c095` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:33.100551 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfddaa69a9644f89320b6bc1f67c095)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:33.102487 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:33.303243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfddaa69a9644f89320b6bc1f67c095'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:33.376140 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfddaa69a9644f89320b6bc1f67c095'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:33.376760 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfddaa69a9644f89320b6bc1f67c095'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:33.383866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfddaa69a9644f89320b6bc1f67c095'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:33.396330 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfddaa69a9644f89320b6bc1f67c095'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:33.402406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1401/2731] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:33 2022] DELETE /identity/v3/users/1dfddaa69a9644f89320b6bc1f67c095 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:33.407525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:33.408043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:33.408146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:33.425437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:33.426641 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:33.484810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1331/2732] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:33.494364 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:33.495792 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:33.574858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f2719-4ea6-487f-8eb4-b9158bb41105 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:33.579359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:33.580000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:33.580288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:33.580565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:33.592344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:33.593885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:33.603629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1402/2733] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:33.994078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:33.995541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:34.009771 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fa6d8-88e7-4ec7-bfd3-5dd32c540817 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:34.014488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:34.015963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:34.016452 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:34.016736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] PATH_INFO: `/v3/projects/c09f231a112543c58e71637c79e9c12d` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:34.018045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09f231a112543c58e71637c79e9c12d)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:34.020195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:34.118875 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09f231a112543c58e71637c79e9c12d', 'request_id': 'req-11e9554d-fd90-4315-af89-80b9ea0d0b47'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.125840 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09f231a112543c58e71637c79e9c12d', 'request_id': 'req-11e9554d-fd90-4315-af89-80b9ea0d0b47'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.198243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09f231a112543c58e71637c79e9c12d', 'request_id': 'req-11e9554d-fd90-4315-af89-80b9ea0d0b47'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.209062 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] The token cache is being invalidate because project c09f231a112543c58e71637c79e9c12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:34.209343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.209955 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.211557 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1332/2734] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:33 2022] DELETE /identity/v3/projects/c09f231a112543c58e71637c79e9c12d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:34.215790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:34.226022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1963b-8a25-4125-b535-5c0273a33822 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:34.263438 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:34.281829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:34.282977 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:34.283246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:34.283519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] PATH_INFO: `/v3/users/30083a67f22745f7abdd4fe5cf8e2591` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:34.284708 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=30083a67f22745f7abdd4fe5cf8e2591)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:34.286621 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:34.452003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30083a67f22745f7abdd4fe5cf8e2591'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.512316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30083a67f22745f7abdd4fe5cf8e2591'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.512937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30083a67f22745f7abdd4fe5cf8e2591'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.520963 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30083a67f22745f7abdd4fe5cf8e2591'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.533164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30083a67f22745f7abdd4fe5cf8e2591'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:34.539189 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1403/2735] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:34 2022] DELETE /identity/v3/users/30083a67f22745f7abdd4fe5cf8e2591 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:34.926056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:34.927541 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:34.942052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9554d-fd90-4315-af89-80b9ea0d0b47 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:34.992307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:35.001168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.002031 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.002315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.002891 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] PATH_INFO: `/v3/projects/e4b7bed93c41400ca73df041cd2297e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.003848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b7bed93c41400ca73df041cd2297e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.005758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:35.118706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b7bed93c41400ca73df041cd2297e2', 'request_id': 'req-11b8cb7a-fb50-4218-8286-1f78c007658c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.125421 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b7bed93c41400ca73df041cd2297e2', 'request_id': 'req-11b8cb7a-fb50-4218-8286-1f78c007658c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.198204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b7bed93c41400ca73df041cd2297e2', 'request_id': 'req-11b8cb7a-fb50-4218-8286-1f78c007658c'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.209122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] The token cache is being invalidate because project e4b7bed93c41400ca73df041cd2297e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:35.209397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.210036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.211627 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1333/2736] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:34 2022] DELETE /identity/v3/projects/e4b7bed93c41400ca73df041cd2297e2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:35.217030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:35.217693 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:35.231815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad4ef-13d9-47a9-b602-86eee6b72dbb admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:35.290536 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.291440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.291869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.292154 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] PATH_INFO: `/v3/users/44a2fcc5fa26423690f2771f03e30e08` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.293337 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a2fcc5fa26423690f2771f03e30e08)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.295346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:35.434273 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a2fcc5fa26423690f2771f03e30e08'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.501392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a2fcc5fa26423690f2771f03e30e08'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.502003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a2fcc5fa26423690f2771f03e30e08'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.507789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:35.510145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a2fcc5fa26423690f2771f03e30e08'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.522188 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-60f23327-0217-4841-bb8a-d487651a3f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a2fcc5fa26423690f2771f03e30e08'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:35.528110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1404/2737] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:35 2022] DELETE /identity/v3/users/44a2fcc5fa26423690f2771f03e30e08 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:35.908226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:35.909752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:35.922830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8cb7a-fb50-4218-8286-1f78c007658c admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:35.980745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:35.981526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:35.981808 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:35.982086 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] PATH_INFO: `/v3/projects/68b1951b0b9a4e7190bfeedb5de7ad15` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:35.983284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b1951b0b9a4e7190bfeedb5de7ad15)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:35.985792 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.091035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b1951b0b9a4e7190bfeedb5de7ad15', 'request_id': 'req-20687593-de7a-4d43-9e69-01868b427aa2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.097566 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b1951b0b9a4e7190bfeedb5de7ad15', 'request_id': 'req-20687593-de7a-4d43-9e69-01868b427aa2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.158051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b1951b0b9a4e7190bfeedb5de7ad15', 'request_id': 'req-20687593-de7a-4d43-9e69-01868b427aa2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.168623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] The token cache is being invalidate because project 68b1951b0b9a4e7190bfeedb5de7ad15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:36.168911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.169532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-20687593-de7a-4d43-9e69-01868b427aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:36.171139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1334/2738] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:35 2022] DELETE /identity/v3/projects/68b1951b0b9a4e7190bfeedb5de7ad15 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:36.177665 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.177959 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.178235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.198100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:36.199352 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.257983 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1405/2739] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:36.266445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.266770 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.267057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.285366 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:36.286559 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.294507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1335/2740] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:54:36.299309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.309018 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85395605-83ba-4942-b438-7b4b9d13d284 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.314836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.315491 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.315774 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.316049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.316780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:36.317088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.318679 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.331115 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1406/2741] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:54:36.335376 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.345961 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d0a3-25c5-4a59-b4ea-09ee8c7ba244 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.350582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.351252 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.351533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.351804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.352480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.354401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.357585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:36.457400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1336/2742] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:36.461787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.473549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb1cbf-2c08-4fdd-a183-dc35efe60175 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.530182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.530799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.531200 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.531656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.532357 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.534316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.603960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1407/2743] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:36.608226 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.619052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bfe2-5114-4a4f-91f6-07158869b012 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.623670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.624325 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.625169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.625790 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.626243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.627857 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.637592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1337/2744] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:36.642350 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.652240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f88a5e-f9c5-4489-8d2f-b080be490d48 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.657565 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea2061-c8ce-4aa4-97cd-0c265bcdee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.658223 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea2061-c8ce-4aa4-97cd-0c265bcdee95 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.658504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea2061-c8ce-4aa4-97cd-0c265bcdee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.658821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea2061-c8ce-4aa4-97cd-0c265bcdee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.659549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea2061-c8ce-4aa4-97cd-0c265bcdee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.661162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea2061-c8ce-4aa4-97cd-0c265bcdee95 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.671045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1408/2745] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:36.675036 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.684728 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdd6fe-fee7-4d0d-b764-196a6b3d3169 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.689984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.690880 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.691160 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.691433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] PATH_INFO: `/v3/projects/b5129136315c46b5ad9614f2f6200777/users/fa7003eedc9b403abe6b0d3470282cd3/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.706623 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5129136315c46b5ad9614f2f6200777, user_id=fa7003eedc9b403abe6b0d3470282cd3, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.709280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:36.769877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1338/2746] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:36 2022] PUT /identity/v3/projects/b5129136315c46b5ad9614f2f6200777/users/fa7003eedc9b403abe6b0d3470282cd3/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:36.793288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.793585 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.793868 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.820359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] MFA Rules not processed for user `fa7003eedc9b403abe6b0d3470282cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:36.821573 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.854033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:36.886546 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1409/2747] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:36.898496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:36.900298 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:36.977683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2a519-628f-4bcc-9366-fff4526b1a50 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:36.981464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83824-b36a-4a27-8859-57b3b35b8b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:36.982113 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83824-b36a-4a27-8859-57b3b35b8b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:36.982399 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83824-b36a-4a27-8859-57b3b35b8b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:36.982679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83824-b36a-4a27-8859-57b3b35b8b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:36.991604 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda83824-b36a-4a27-8859-57b3b35b8b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:36.993314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda83824-b36a-4a27-8859-57b3b35b8b1b service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.002652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1339/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:37.027219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.088998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3b26d-6a84-4d13-bc37-b1e5d4d1d848 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.093683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.094558 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.094877 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.095156 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] PATH_INFO: `/v3/users/fa7003eedc9b403abe6b0d3470282cd3` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.096366 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7003eedc9b403abe6b0d3470282cd3)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.098293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.274759 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7003eedc9b403abe6b0d3470282cd3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:37.352517 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7003eedc9b403abe6b0d3470282cd3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:37.353059 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7003eedc9b403abe6b0d3470282cd3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:37.361290 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7003eedc9b403abe6b0d3470282cd3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:37.373070 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7003eedc9b403abe6b0d3470282cd3'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:37.379162 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1410/2749] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:54:37 2022] DELETE /identity/v3/users/fa7003eedc9b403abe6b0d3470282cd3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:37.383705 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.383998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.384275 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.401389 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:37.402590 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:37.462763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1340/2750] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:37.472819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.474252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:37.531440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b090d7-c42e-48fe-a09b-a50fefba3b3b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.535096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea4cc2-4eac-4879-8978-f84f099fe0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.535749 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea4cc2-4eac-4879-8978-f84f099fe0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.536034 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea4cc2-4eac-4879-8978-f84f099fe0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.536318 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea4cc2-4eac-4879-8978-f84f099fe0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.543842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:37.546088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea4cc2-4eac-4879-8978-f84f099fe0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.548182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea4cc2-4eac-4879-8978-f84f099fe0a2 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:37.557674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1411/2751] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:37.961183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:37.961183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:37.971936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab8bb5-da1d-42c5-abf6-525b1ec3a627 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:37.978050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:37.979244 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:37.979361 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:37.979569 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] PATH_INFO: `/v3/projects/b5129136315c46b5ad9614f2f6200777` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:37.981069 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5129136315c46b5ad9614f2f6200777)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:37.982848 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.064576 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:38.079982 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5129136315c46b5ad9614f2f6200777', 'request_id': 'req-d37be223-939b-4a6f-98fc-10853e6281df'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:38.086321 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5129136315c46b5ad9614f2f6200777', 'request_id': 'req-d37be223-939b-4a6f-98fc-10853e6281df'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:38.146654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5129136315c46b5ad9614f2f6200777', 'request_id': 'req-d37be223-939b-4a6f-98fc-10853e6281df'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:38.158043 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] The token cache is being invalidate because project b5129136315c46b5ad9614f2f6200777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:54:38.158329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:38.159010 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-d37be223-939b-4a6f-98fc-10853e6281df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:54:38.160524 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1341/2752] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:54:37 2022] DELETE /identity/v3/projects/b5129136315c46b5ad9614f2f6200777 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:38.165999 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.166293 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.166600 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.184149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:38.185448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:38.246359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1412/2753] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:38.254944 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.255234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.255628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.277078 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:38.278272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:38.287834 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1342/2754] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:38.292274 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.302103 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb25e0-be00-4972-9922-5bc36679cc21 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.306722 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.307404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.307690 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.307973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.308723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:54:38.309033 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.310667 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.322894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1413/2755] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:54:38.327157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.336946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edc0d-002a-4539-859d-57a8e245a2f6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.341839 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.342481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.342799 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.343074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.343821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.345689 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.428579 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1343/2756] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:38 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:38.433117 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.443949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe50f72-6b5c-49cc-ae29-be9fdaccb515 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.499139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.500388 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.500664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.500941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.501638 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.503578 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.564526 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1414/2757] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:38 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:38.568732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.579779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada18808-8f2a-421d-aa9e-6f02c6e044e9 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.584406 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.585087 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.585369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.585643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.586370 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.588225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.599001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1344/2758] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:38.602788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.613685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba0213-abf0-4dc2-9779-55294b3c7594 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.618393 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d0da9-76ac-412e-9a4f-9ec1b80e60da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.619092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d0da9-76ac-412e-9a4f-9ec1b80e60da admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.619403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d0da9-76ac-412e-9a4f-9ec1b80e60da admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.619684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d0da9-76ac-412e-9a4f-9ec1b80e60da admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.620416 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d0da9-76ac-412e-9a4f-9ec1b80e60da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.622010 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d0da9-76ac-412e-9a4f-9ec1b80e60da admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.632686 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1415/2759] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:38.636729 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.647175 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f1eab-163b-4a77-b47b-16453f300a66 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.651659 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.652525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.652806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.653074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] PATH_INFO: `/v3/projects/7f4bd37601514e8bb2ca8462084f7651/users/965f226409f64b11883d86162cc491f4/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.674423 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4bd37601514e8bb2ca8462084f7651, user_id=965f226409f64b11883d86162cc491f4, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.677149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.758606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1345/2760] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:38 2022] PUT /identity/v3/projects/7f4bd37601514e8bb2ca8462084f7651/users/965f226409f64b11883d86162cc491f4/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:38.763709 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372f942-aaa7-4990-8af4-cf69627e2bef None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.764007 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372f942-aaa7-4990-8af4-cf69627e2bef None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.764289 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372f942-aaa7-4990-8af4-cf69627e2bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.783313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-3372f942-aaa7-4990-8af4-cf69627e2bef None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:38.784554 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3372f942-aaa7-4990-8af4-cf69627e2bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:38.843737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1416/2761] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:38.853262 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:38.855114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:38.911436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63057cb3-2533-4487-b959-a410f24f4416 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:38.915148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:38.915789 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:38.916081 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:38.916359 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:38.926056 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:38.927507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:38.936950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1346/2762] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:44.000118 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.000594 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.000704 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.006562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:44.031110 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] MFA Rules not processed for user `965f226409f64b11883d86162cc491f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:44.032139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:44.112893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1417/2763] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:44.117509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.129540 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6b04-79fc-4d82-a64c-3954d1ed4897 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.134232 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.134940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.135220 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.135498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.136331 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.138234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.229260 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1347/2764] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:54:44 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:54:44.233157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.245030 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab7c6-70ea-4d16-bfa2-2e1156b2f8f6 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.305926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.306599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.306911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.307186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.307880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.312515 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.398898 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1418/2765] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:54:44 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:54:44.408384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.418760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcd452-108d-4209-a969-7a7c791086ce admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.424440 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.425139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.425445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.425718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.426444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.428070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.439672 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1348/2766] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:44.443842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.454131 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f985-acfb-4d60-8ef2-6ff5856dca9b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.458674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.459581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.459860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.460135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] PATH_INFO: `/v3/projects/c3dab77b24194c17b9f38a6c54fb8f37/users/7084c6a52efb42569878d8f5fcf542d2/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.475213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dab77b24194c17b9f38a6c54fb8f37, user_id=7084c6a52efb42569878d8f5fcf542d2, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.478284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.554311 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1419/2767] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:44 2022] PUT /identity/v3/projects/c3dab77b24194c17b9f38a6c54fb8f37/users/7084c6a52efb42569878d8f5fcf542d2/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:54:44.558425 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.569310 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51d26-eeb2-4f1e-91d3-21c7eaaeb7be admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.587469 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:44.626971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee677cfe-89b8-4916-9c61-41672f1c339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.627643 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677cfe-89b8-4916-9c61-41672f1c339c admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.627931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677cfe-89b8-4916-9c61-41672f1c339c admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.628207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677cfe-89b8-4916-9c61-41672f1c339c admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.628936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee677cfe-89b8-4916-9c61-41672f1c339c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.630555 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee677cfe-89b8-4916-9c61-41672f1c339c admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.640459 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1349/2768] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:54:44.644664 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:44.655264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e262-e101-4027-97b7-b96086bb93a2 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:44.660183 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:44.661077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:44.661363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:44.661645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] PATH_INFO: `/v3/projects/c3dab77b24194c17b9f38a6c54fb8f37/users/7084c6a52efb42569878d8f5fcf542d2/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:44.663715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dab77b24194c17b9f38a6c54fb8f37, user_id=7084c6a52efb42569878d8f5fcf542d2, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:44.666374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:44.677753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1420/2769] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:54:44 2022] PUT /identity/v3/projects/c3dab77b24194c17b9f38a6c54fb8f37/users/7084c6a52efb42569878d8f5fcf542d2/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:54:50.392974 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a627-2de9-4c03-a431-4343f2a7e38a None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:50.393537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a627-2de9-4c03-a431-4343f2a7e38a None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:50.393537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a627-2de9-4c03-a431-4343f2a7e38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:50.424205 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7ac4a627-2de9-4c03-a431-4343f2a7e38a None None] MFA Rules not processed for user `7084c6a52efb42569878d8f5fcf542d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:50.425701 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7ac4a627-2de9-4c03-a431-4343f2a7e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:50.501074 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1350/2770] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:50.513039 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:50.515075 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:50.564295 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:50.575684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0724d7-ed48-48a7-abe0-52c8cbe35516 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:50.579899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d5722330cc432ea6b3c4f505a78669', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:50.580563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:50.580847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:50.581126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:50.643772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:50.645272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:50.654920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1421/2771] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:54:50.897335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1554-7342-43b3-9420-722923e2d7b2 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:50.897628 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1554-7342-43b3-9420-722923e2d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:50.897909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1554-7342-43b3-9420-722923e2d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:50.928386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b0ed1554-7342-43b3-9420-722923e2d7b2 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:54:50.929606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b0ed1554-7342-43b3-9420-722923e2d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:51.007779 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1351/2772] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:54:51.163829 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:54:51.164050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:54:51.239901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1f3c-8bee-4c13-8539-8858239caed9 service glance] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:54:51.245210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:54:51.245924 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:54:51.246204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:54:51.246475 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:54:51.255808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:54:51.257394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:54:51.267308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1422/2773] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:54:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:55:00.999746 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=85 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:01.262428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=60 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:01.760567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5df64-39e4-4364-af91-2b99d3006e78 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:55:01.760861 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5df64-39e4-4364-af91-2b99d3006e78 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:55:01.761140 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5df64-39e4-4364-af91-2b99d3006e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:55:01.779905 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-29d5df64-39e4-4364-af91-2b99d3006e78 None None] MFA Rules not processed for user `965f226409f64b11883d86162cc491f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:55:01.781143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-29d5df64-39e4-4364-af91-2b99d3006e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:55:01.788243 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1352/2774] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:55:03.825610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:55:03.827976 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:55:03.924013 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff451d59-9652-4b9e-b02a-73a305d459df service swift] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:55:03.929163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:55:03.929814 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:55:03.930100 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:55:03.930377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:55:03.932206 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:55:03.944873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:55:03.946723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:55:03.956901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1423/2775] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:55:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:55:05.367007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:55:05.367474 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:55:05.367581 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:55:05.386045 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:55:05.387283 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:55:05.394542 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1353/2776] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Jul 21 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:55:05.407648 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:55:05.419308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea4edd-9056-4bb4-acc0-f608a0a9ec1e service placement] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:55:05.425094 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:55:05.425927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:55:05.434077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:55:05.434077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:55:05.435434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:55:05.437846 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:55:05.447012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1424/2777] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:55:15.380552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=6 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:15.444778 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=47 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:28.806868 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:55:28.808350 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:55:28.863723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a557-80d8-4c75-b4f1-8d121e159327 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:55:28.867341 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e35e-4c52-41b4-baf9-24136698d884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:55:28.867984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e35e-4c52-41b4-baf9-24136698d884 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:55:28.868264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e35e-4c52-41b4-baf9-24136698d884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:55:28.868537 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e35e-4c52-41b4-baf9-24136698d884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:55:28.877424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e35e-4c52-41b4-baf9-24136698d884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:55:28.878866 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e35e-4c52-41b4-baf9-24136698d884 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:55:28.888856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1354/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:55:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:55:38.884712 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=26 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:14.248367 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:56:14.257920 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1235dd-bc83-4278-8d19-d442110a909c service swift] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:56:14.261453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:56:14.262092 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:56:14.262382 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:56:14.262658 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:56:14.264442 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:56:14.348879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:56:14.350329 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6b72f-ddea-4944-8ff8-afe1fea8e17f service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:56:14.370133 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1425/2779] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:56:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:56:24.367513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=43 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:36.001116 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:56:36.005680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:56:36.005680 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:56:36.020804 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] MFA Rules not processed for user `8a443b587dc844d48b64aef7434f3f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:56:36.024394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:56:36.076132 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1355/2780] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:56:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:56:46.069583 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=25 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:59.673903 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:56:59.674427 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:56:59.674580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:56:59.727860 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] MFA Rules not processed for user `9fe49b9d7762442aa250c9686d5bfce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:56:59.729175 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:56:59.747315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1426/2781] 10.222.0.49 () {58 vars in 967 bytes} [Thu Jul 21 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:56:59.795095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:56:59.818100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565f583-0942-4517-b5d9-7a5f5377267e None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:56:59.823242 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ea97317d564485a0982fe7533561be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:56:59.823890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:56:59.824174 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:56:59.824450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:56:59.833985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:56:59.835587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:56:59.843733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1356/2782] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Jul 21 10:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 10:57:03.997035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:04.009711 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:04.013560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cfaad-565f-4e18-9109-cc18ff5bc25d None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:04.019027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:04.019677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:04.019994 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:04.020272 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:04.022141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:04.035750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:04.039209 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:04.048201 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1427/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:07.467873 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:07.540592 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929c248-6bc5-4ae7-b5b7-ea3ef23fdac8 service swift] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:07.545315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:07.546125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:07.546408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:07.546682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] PATH_INFO: `/v3/users/965f226409f64b11883d86162cc491f4` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:07.548365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=965f226409f64b11883d86162cc491f4)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:07.550212 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:07.753907 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965f226409f64b11883d86162cc491f4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:07.842752 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965f226409f64b11883d86162cc491f4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:07.855462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965f226409f64b11883d86162cc491f4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:07.858573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965f226409f64b11883d86162cc491f4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:07.863227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965f226409f64b11883d86162cc491f4'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:07.869575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1357/2784] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:07 2022] DELETE /identity/v3/users/965f226409f64b11883d86162cc491f4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:08.142613 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:08.158461 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de39991-1846-4a03-a91e-db016cb08cb2 service placement] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:08.212673 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:08.213532 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:08.213869 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:08.214152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] PATH_INFO: `/v3/projects/7f4bd37601514e8bb2ca8462084f7651` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:08.215333 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4bd37601514e8bb2ca8462084f7651)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:08.217291 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:08.438377 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4bd37601514e8bb2ca8462084f7651', 'request_id': 'req-3ff36447-65df-4eee-956d-db1660fa9e78'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.444783 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4bd37601514e8bb2ca8462084f7651', 'request_id': 'req-3ff36447-65df-4eee-956d-db1660fa9e78'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.512360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4bd37601514e8bb2ca8462084f7651', 'request_id': 'req-3ff36447-65df-4eee-956d-db1660fa9e78'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.523744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] The token cache is being invalidate because project 7f4bd37601514e8bb2ca8462084f7651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:08.524027 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.524645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.526178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1428/2785] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:08 2022] DELETE /identity/v3/projects/7f4bd37601514e8bb2ca8462084f7651 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:08.530300 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:08.531774 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:08.544899 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd7585-bb0b-4eb7-909b-449a2e05d23b admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:08.596156 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:08.601984 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:08.602892 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:08.603178 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:08.603453 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] PATH_INFO: `/v3/users/7084c6a52efb42569878d8f5fcf542d2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:08.604730 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7084c6a52efb42569878d8f5fcf542d2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:08.606809 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:08.753364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7084c6a52efb42569878d8f5fcf542d2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.832688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7084c6a52efb42569878d8f5fcf542d2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.847009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7084c6a52efb42569878d8f5fcf542d2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.847654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7084c6a52efb42569878d8f5fcf542d2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.854418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7084c6a52efb42569878d8f5fcf542d2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:08.860634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1358/2786] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:08 2022] DELETE /identity/v3/users/7084c6a52efb42569878d8f5fcf542d2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:09.112833 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:09.114674 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:09.127766 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff36447-65df-4eee-956d-db1660fa9e78 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:09.165368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:09.187873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:09.188800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:09.189096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:09.189346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] PATH_INFO: `/v3/projects/c3dab77b24194c17b9f38a6c54fb8f37` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:09.190543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3dab77b24194c17b9f38a6c54fb8f37)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:09.192449 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:09.304947 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3dab77b24194c17b9f38a6c54fb8f37', 'request_id': 'req-8fa0aef0-b1ce-4844-b379-30f9678a012c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:09.311049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3dab77b24194c17b9f38a6c54fb8f37', 'request_id': 'req-8fa0aef0-b1ce-4844-b379-30f9678a012c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:09.397984 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3dab77b24194c17b9f38a6c54fb8f37', 'request_id': 'req-8fa0aef0-b1ce-4844-b379-30f9678a012c'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:09.408795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] The token cache is being invalidate because project c3dab77b24194c17b9f38a6c54fb8f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:09.409072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:09.409683 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:09.411404 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1429/2787] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:09 2022] DELETE /identity/v3/projects/c3dab77b24194c17b9f38a6c54fb8f37 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:18.856732 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:19.547284 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:25.835430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:25.836885 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:25.895654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d139cb6-512c-49f6-879b-6542a0b0df5a admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:25.949189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:25.949189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:25.949189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:25.949189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:25.949765 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:25.959903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:25.961336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:25.969418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1359/2788] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:57:35.965654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=46 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:39.811735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:39.813417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:39.903254 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0aef0-b1ce-4844-b379-30f9678a012c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:39.909932 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be525488dbf496cb0440dc4b046df85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:39.910937 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:39.911314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:39.911599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:39.913549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:39.926893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:39.928655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:39.940986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1430/2789] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:49.825688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:49.827157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:49.898001 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f86aa-44c1-42b3-93ba-4e905331a4cb service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:49.903204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:49.903851 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:49.904139 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:49.904419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:49.906216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:49.918304 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:49.919909 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:49.931835 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1360/2790] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:49.934955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:49.937519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=34 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:49.937519 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:50.006400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2a4e-3b21-488d-8def-017fc0d0aed4 service nova] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:50.010930 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:50.011795 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:50.012073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:50.012344 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] PATH_INFO: `/v3/users/8a443b587dc844d48b64aef7434f3f49` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:50.013513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a443b587dc844d48b64aef7434f3f49)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:50.015463 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:50.175210 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a443b587dc844d48b64aef7434f3f49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.260199 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a443b587dc844d48b64aef7434f3f49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.260810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a443b587dc844d48b64aef7434f3f49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.267871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a443b587dc844d48b64aef7434f3f49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.280149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-7232929f-963e-4d75-8104-10ec36a2770f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a443b587dc844d48b64aef7434f3f49'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.286586 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1431/2791] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:57:49 2022] DELETE /identity/v3/users/8a443b587dc844d48b64aef7434f3f49 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:50.541181 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:50.552742 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d954562-7ef3-49ba-b851-4c3b726c7bdb service placement] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:50.613647 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:50.614532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:50.614860 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:50.615141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] PATH_INFO: `/v3/projects/f3573c5fade84778a9dc304df2f8c9ff` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:50.616339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3573c5fade84778a9dc304df2f8c9ff)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:50.618286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:50.741223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3573c5fade84778a9dc304df2f8c9ff', 'request_id': 'req-7f47cde5-8697-4796-b2fd-de3df07fefd2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.747501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3573c5fade84778a9dc304df2f8c9ff', 'request_id': 'req-7f47cde5-8697-4796-b2fd-de3df07fefd2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.836272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3573c5fade84778a9dc304df2f8c9ff', 'request_id': 'req-7f47cde5-8697-4796-b2fd-de3df07fefd2'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.847532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] The token cache is being invalidate because project f3573c5fade84778a9dc304df2f8c9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:57:50.847940 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.848692 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-7f47cde5-8697-4796-b2fd-de3df07fefd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:57:50.850230 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1361/2792] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:57:50 2022] DELETE /identity/v3/projects/f3573c5fade84778a9dc304df2f8c9ff => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:57:50.859373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:50.859662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:50.859941 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:50.879728 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:50.880979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:50.940244 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1432/2793] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:50.948571 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:50.948856 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:50.949130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:50.967023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:50.968213 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:50.976021 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1362/2794] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:50.980079 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:50.990120 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bceb-742e-4abd-80ff-8cfc9c9461d1 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:50.994668 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:50.995341 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:50.995626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:50.995902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:50.996633 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:57:50.996939 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:50.998520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.010548 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1433/2795] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:57:51.014682 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.024168 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea68b2e-a20c-4718-a02a-cdde36988f2c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.028823 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.029475 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.029758 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.030039 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.030763 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.032649 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.042369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:51.147326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1363/2796] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:51 2022] POST /identity/v3/projects => generated 353 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:51.151650 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.162087 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a4e08-6a5e-4b5c-83ce-5f3c8c6be4ba admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.165610 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:51.218537 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.219234 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.219513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.219811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.220503 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.223063 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.306484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1434/2797] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:51 2022] POST /identity/v3/users => generated 277 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:51.310894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.323405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15babaea-512f-4260-bdc8-9fb5ec7e6f94 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.328430 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.329106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.329395 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.329675 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.330670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.332466 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.342490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1364/2798] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:51.346528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.357099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5c36-8825-450f-b518-9785257361de admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.361691 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44db24-8ed6-4763-852e-b885b3ad2c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.362346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44db24-8ed6-4763-852e-b885b3ad2c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.362675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44db24-8ed6-4763-852e-b885b3ad2c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.363485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44db24-8ed6-4763-852e-b885b3ad2c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.364257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44db24-8ed6-4763-852e-b885b3ad2c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.365858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44db24-8ed6-4763-852e-b885b3ad2c9b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.375748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1435/2799] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:51.379726 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.389698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213b26-b067-4915-a34f-67cec868e975 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.394494 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.395397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.395685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.395964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] PATH_INFO: `/v3/projects/ab03f2f9575a43c8b198da51af5b8aa2/users/cd360ba18d224e888f351067a28e6a59/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.411234 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab03f2f9575a43c8b198da51af5b8aa2, user_id=cd360ba18d224e888f351067a28e6a59, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.413898 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.483114 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1365/2800] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:51 2022] PUT /identity/v3/projects/ab03f2f9575a43c8b198da51af5b8aa2/users/cd360ba18d224e888f351067a28e6a59/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:51.495002 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.495298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.495579 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.521560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] MFA Rules not processed for user `cd360ba18d224e888f351067a28e6a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:51.522811 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:51.585676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1436/2801] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:51.590103 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.653784 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff4d5-5dde-43dc-a511-c953faf67fc8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.658320 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.659009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.659291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.660208 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.661246 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.663161 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.735817 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1366/2802] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:57:51 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:51.740021 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.750426 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119dcec-673d-419f-b1bb-a422f62441e0 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.807141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.807813 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.808098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.808376 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.809072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.811003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.883910 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1437/2803] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:57:51 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:57:51.887916 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.898336 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f01b04-82bb-4e50-b82e-037317d426fc admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.902977 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.903633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.903919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.904194 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.905000 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.906585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:51.917488 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1367/2804] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:51.921636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:51.928497 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:51.932647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf136-9d27-42d7-b261-40b34b73632b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:51.937263 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:51.938160 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:51.946789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:51.946789 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] PATH_INFO: `/v3/projects/7e015aa5a9524356a9f04583fbc142c3/users/a2cc0e9cfdfb4cf798632f8063420a4e/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:51.952968 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e015aa5a9524356a9f04583fbc142c3, user_id=a2cc0e9cfdfb4cf798632f8063420a4e, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:51.955878 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:52.002214 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1438/2805] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:51 2022] PUT /identity/v3/projects/7e015aa5a9524356a9f04583fbc142c3/users/a2cc0e9cfdfb4cf798632f8063420a4e/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:52.006211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:52.016326 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da6d8-6e58-4bac-8574-2e0e3dfb4743 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:52.072144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43437-40b5-47b9-a546-39a17256a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:52.072807 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43437-40b5-47b9-a546-39a17256a62f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:52.073090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43437-40b5-47b9-a546-39a17256a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:52.073364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43437-40b5-47b9-a546-39a17256a62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:52.074082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43437-40b5-47b9-a546-39a17256a62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:52.075707 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43437-40b5-47b9-a546-39a17256a62f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:52.085966 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1368/2806] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:57:52.090050 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:52.101114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1b76-6961-48c5-a1cf-e32da352676b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:52.105676 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:52.106552 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:52.106864 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:52.107147 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] PATH_INFO: `/v3/projects/7e015aa5a9524356a9f04583fbc142c3/users/a2cc0e9cfdfb4cf798632f8063420a4e/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:52.109108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e015aa5a9524356a9f04583fbc142c3, user_id=a2cc0e9cfdfb4cf798632f8063420a4e, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:52.111794 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:52.122423 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1439/2807] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:57:52 2022] PUT /identity/v3/projects/7e015aa5a9524356a9f04583fbc142c3/users/a2cc0e9cfdfb4cf798632f8063420a4e/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:57:52.132426 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:52.132714 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:52.132989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:52.158739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] MFA Rules not processed for user `a2cc0e9cfdfb4cf798632f8063420a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:57:52.160927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:52.166023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:52.228711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1369/2808] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:57:52.240473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:52.242205 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:57:52.298528 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f13f7-7ce2-4859-9036-a617fcf0baf1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:52.302403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:52.303077 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:52.303363 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:52.303637 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:52.312535 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:52.313953 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:52.323734 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1440/2809] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:52 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:57:52.466340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:57:52.476311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d48beb-c18e-4af5-9ac2-1a63f0d2f00c None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:57:52.479913 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ec3e-a9c1-482b-a84f-0e681e833949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:57:52.480552 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ec3e-a9c1-482b-a84f-0e681e833949 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:57:52.480836 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ec3e-a9c1-482b-a84f-0e681e833949 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:57:52.481112 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ec3e-a9c1-482b-a84f-0e681e833949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:57:52.537684 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ec3e-a9c1-482b-a84f-0e681e833949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:57:52.539157 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ec3e-a9c1-482b-a84f-0e681e833949 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:57:52.548143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1370/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:57:52 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:02.319271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:02.543965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=54 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:10.735662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:10.796905 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7e746-f9f4-4d14-a364-cb8b934de062 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:10.802149 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:10.803135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:10.803428 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:10.803700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] PATH_INFO: `/v3/users/cd360ba18d224e888f351067a28e6a59` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:10.804870 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd360ba18d224e888f351067a28e6a59)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:10.806880 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:10.963259 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd360ba18d224e888f351067a28e6a59'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.048380 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd360ba18d224e888f351067a28e6a59'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.049024 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd360ba18d224e888f351067a28e6a59'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.056914 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd360ba18d224e888f351067a28e6a59'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.068990 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd360ba18d224e888f351067a28e6a59'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.074992 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1441/2811] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:10 2022] DELETE /identity/v3/users/cd360ba18d224e888f351067a28e6a59 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:11.079567 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.080291 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.080400 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.099179 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:11.100378 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:11.158067 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1371/2812] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:11.168300 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.169694 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:11.226145 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3719-8909-4a83-bcd3-ccb9d2b8fc44 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.229636 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.230266 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.230566 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.230873 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.240417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.241824 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:11.251148 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1442/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:11.654183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.655754 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:11.668293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3238ec-b820-4057-aa7d-0ffd99976255 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.673003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.673965 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.674316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.674600 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] PATH_INFO: `/v3/projects/ab03f2f9575a43c8b198da51af5b8aa2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.675890 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab03f2f9575a43c8b198da51af5b8aa2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.677806 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:11.784207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab03f2f9575a43c8b198da51af5b8aa2', 'request_id': 'req-5fec125b-eef2-4c84-9512-b51e11471243'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.790505 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab03f2f9575a43c8b198da51af5b8aa2', 'request_id': 'req-5fec125b-eef2-4c84-9512-b51e11471243'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.842401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab03f2f9575a43c8b198da51af5b8aa2', 'request_id': 'req-5fec125b-eef2-4c84-9512-b51e11471243'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.853240 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] The token cache is being invalidate because project ab03f2f9575a43c8b198da51af5b8aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:11.853526 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.854141 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:11.855703 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1372/2814] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:11 2022] DELETE /identity/v3/projects/ab03f2f9575a43c8b198da51af5b8aa2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:11.859670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:11.869858 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1cc27-410e-4f07-92b4-9e8f1a19b813 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:11.888174 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.926088 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:11.927029 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:11.927543 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:11.928001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] PATH_INFO: `/v3/users/a2cc0e9cfdfb4cf798632f8063420a4e` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:11.929587 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cc0e9cfdfb4cf798632f8063420a4e)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:11.931542 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.083186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cc0e9cfdfb4cf798632f8063420a4e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.155163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cc0e9cfdfb4cf798632f8063420a4e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.155819 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cc0e9cfdfb4cf798632f8063420a4e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.163414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cc0e9cfdfb4cf798632f8063420a4e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.175677 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e25e64aa-98fb-4704-8081-979771109f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cc0e9cfdfb4cf798632f8063420a4e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.181684 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1443/2815] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:11 2022] DELETE /identity/v3/users/a2cc0e9cfdfb4cf798632f8063420a4e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:12.553169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:12.554769 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.570490 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec125b-eef2-4c84-9512-b51e11471243 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:12.629188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:12.630003 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.630285 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.630562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] PATH_INFO: `/v3/projects/7e015aa5a9524356a9f04583fbc142c3` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.631783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e015aa5a9524356a9f04583fbc142c3)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:12.633686 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:12.769793 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:12.787007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e015aa5a9524356a9f04583fbc142c3', 'request_id': 'req-a3c41fd2-4df9-4489-9e10-0181bb50c03a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.793371 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e015aa5a9524356a9f04583fbc142c3', 'request_id': 'req-a3c41fd2-4df9-4489-9e10-0181bb50c03a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.857954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e015aa5a9524356a9f04583fbc142c3', 'request_id': 'req-a3c41fd2-4df9-4489-9e10-0181bb50c03a'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.869111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] The token cache is being invalidate because project 7e015aa5a9524356a9f04583fbc142c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:12.869394 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.870084 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-a3c41fd2-4df9-4489-9e10-0181bb50c03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:12.871973 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1373/2816] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:12 2022] DELETE /identity/v3/projects/7e015aa5a9524356a9f04583fbc142c3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:12.878484 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.879001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.879152 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.896421 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:12.897562 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.956346 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1444/2817] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:12.964050 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:12.964346 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:12.964624 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:12.983329 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:12.984532 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:12.993207 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1374/2818] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:12.997218 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.006882 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ef1b8-c4df-496c-b8f2-890652cf3f1f None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.011403 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.012051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.012331 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.012604 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.013325 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:13.013629 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.015235 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.026753 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1445/2819] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:13.030826 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.040858 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb852-27d1-41d6-8385-c10591c7a5e9 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.045719 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.046372 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.046652 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.046956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.047644 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.050148 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.151276 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1375/2820] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:13 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:13.155369 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.165821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4387-0c5e-455a-bb48-93d39d108b40 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.191591 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:13.220685 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.221851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.222132 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.222460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.223165 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.225058 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.333164 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1446/2821] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:13 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:13.337404 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.348418 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37bcb-bdc3-49a3-9bbf-3f4edd8aeee9 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.353070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.353724 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.354008 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.354286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.359683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.359683 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.367405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1376/2822] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:13.371286 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.381098 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d206-97b3-4358-945d-37bd55d05768 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.385817 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23a836-7240-4188-8cdf-4eda5de660fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.386975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23a836-7240-4188-8cdf-4eda5de660fb admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.386975 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23a836-7240-4188-8cdf-4eda5de660fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.387192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23a836-7240-4188-8cdf-4eda5de660fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.387748 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23a836-7240-4188-8cdf-4eda5de660fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.389320 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23a836-7240-4188-8cdf-4eda5de660fb admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.400221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1447/2823] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:13.404314 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.415297 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02175ea-3d60-4407-9b7c-432b3acd34ea admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.419946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.420846 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.421125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.421397 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] PATH_INFO: `/v3/projects/2d9b3003d6ac4daab68d97923d190aff/users/e6a2ad5b9f0c469fa60ed90e8b03ad18/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.435702 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9b3003d6ac4daab68d97923d190aff, user_id=e6a2ad5b9f0c469fa60ed90e8b03ad18, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.438348 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.532596 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1377/2824] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:13 2022] PUT /identity/v3/projects/2d9b3003d6ac4daab68d97923d190aff/users/e6a2ad5b9f0c469fa60ed90e8b03ad18/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:13.554570 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.554893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.555168 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.581750 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] MFA Rules not processed for user `e6a2ad5b9f0c469fa60ed90e8b03ad18`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:13.583130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:13.647126 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1448/2825] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:13.651741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.714751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99b242-49ae-4416-8e7a-f801d5857725 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.719543 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.720189 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.720483 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.720764 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.721681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.723631 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.820796 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1378/2826] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:13 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:58:13.824775 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.836862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fec963-f282-42c1-a429-9b86e8f3ab55 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.891271 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.892003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.892294 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.892571 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.893899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.895875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:13.963406 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1449/2827] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:13 2022] POST /identity/v3/users => generated 307 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:13.971969 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:13.982338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0154-8317-4031-8d1f-3e184d5cfa86 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:13.987551 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:13.988216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:13.988503 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:13.988783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:13.989513 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:13.991137 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:14.001512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1379/2828] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:14.006643 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:14.016724 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0de41f-0d2d-4df5-9bff-4e7499303df7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:14.021723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:14.022599 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:14.022911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:14.023182 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] PATH_INFO: `/v3/projects/60682c9cc90548bd9a60cf5317f5248d/users/50047177f44e48a6890f08ea69e717ab/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:14.037580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] RBAC: Authorizing `identity:create_grant(project_id=60682c9cc90548bd9a60cf5317f5248d, user_id=50047177f44e48a6890f08ea69e717ab, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:14.040236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:14.105219 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1450/2829] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:14 2022] PUT /identity/v3/projects/60682c9cc90548bd9a60cf5317f5248d/users/50047177f44e48a6890f08ea69e717ab/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:14.109278 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:14.119936 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f27e7-0704-4451-bce5-73ff84565d28 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:14.140070 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:14.176482 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a48d-ff5c-4626-8e90-e43da0393f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:14.177149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a48d-ff5c-4626-8e90-e43da0393f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:14.177437 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a48d-ff5c-4626-8e90-e43da0393f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:14.177718 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a48d-ff5c-4626-8e90-e43da0393f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:14.178443 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7a48d-ff5c-4626-8e90-e43da0393f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:14.180108 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7a48d-ff5c-4626-8e90-e43da0393f86 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:14.190721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1380/2830] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:14.195227 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:14.200653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:14.206298 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f695b-f69a-4591-9123-e2f225af10be admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:14.211016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:14.211901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:14.212185 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:14.212462 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] PATH_INFO: `/v3/projects/60682c9cc90548bd9a60cf5317f5248d/users/50047177f44e48a6890f08ea69e717ab/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:14.214493 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60682c9cc90548bd9a60cf5317f5248d, user_id=50047177f44e48a6890f08ea69e717ab, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:14.217099 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:14.227374 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1451/2831] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:14 2022] PUT /identity/v3/projects/60682c9cc90548bd9a60cf5317f5248d/users/50047177f44e48a6890f08ea69e717ab/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:14.237884 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:14.238217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:14.238515 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:14.264842 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] MFA Rules not processed for user `50047177f44e48a6890f08ea69e717ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:14.266063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:14.333259 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1381/2832] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:14.343854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:14.345567 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:14.401929 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2358c-f100-463d-a294-e3907b98dcf3 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:14.405563 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:14.406196 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:14.406476 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:14.406785 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:14.416828 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:14.418247 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:14.428596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1452/2833] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:14.650375 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:14.660626 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8e47c-5a08-4073-8104-90132a747f76 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:14.664401 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243da12-e9de-4a01-8de0-7ea1a29d2869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:14.665142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243da12-e9de-4a01-8de0-7ea1a29d2869 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:14.665431 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243da12-e9de-4a01-8de0-7ea1a29d2869 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:14.665711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243da12-e9de-4a01-8de0-7ea1a29d2869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:14.724177 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243da12-e9de-4a01-8de0-7ea1a29d2869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:14.725608 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243da12-e9de-4a01-8de0-7ea1a29d2869 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:14.734985 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1382/2834] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:19.715974 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:19.792705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c608c-effc-4e1a-81e9-94e7e1b16afa service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:19.792705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:19.792995 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:19.793283 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:19.793560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] PATH_INFO: `/v3/users/e6a2ad5b9f0c469fa60ed90e8b03ad18` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:19.794802 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a2ad5b9f0c469fa60ed90e8b03ad18)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:19.796735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:19.970176 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a2ad5b9f0c469fa60ed90e8b03ad18'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.030918 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a2ad5b9f0c469fa60ed90e8b03ad18'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.031561 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a2ad5b9f0c469fa60ed90e8b03ad18'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.038735 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a2ad5b9f0c469fa60ed90e8b03ad18'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.051417 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a2ad5b9f0c469fa60ed90e8b03ad18'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.057418 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1453/2835] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:19 2022] DELETE /identity/v3/users/e6a2ad5b9f0c469fa60ed90e8b03ad18 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:20.061988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.062496 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.062606 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.080295 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:20.081853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.121381 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=100 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:20.140570 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1383/2836] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:20.150355 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.151800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.165276 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:20.209888 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a19-038e-49af-bc10-979817c1c40a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.214083 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.214883 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.215580 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.215944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.225518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.226900 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.237230 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1454/2837] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:20.638481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.640119 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:20.652601 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6912203-a814-4e2e-9f63-5de9d658c731 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.657190 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.658121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.659028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.659266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] PATH_INFO: `/v3/projects/2d9b3003d6ac4daab68d97923d190aff` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.660539 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9b3003d6ac4daab68d97923d190aff)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.662436 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:20.798041 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9b3003d6ac4daab68d97923d190aff', 'request_id': 'req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.804294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9b3003d6ac4daab68d97923d190aff', 'request_id': 'req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.853989 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9b3003d6ac4daab68d97923d190aff', 'request_id': 'req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.864546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] The token cache is being invalidate because project 2d9b3003d6ac4daab68d97923d190aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:20.864827 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.865433 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:20.867007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1384/2838] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:20 2022] DELETE /identity/v3/projects/2d9b3003d6ac4daab68d97923d190aff => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:20.870955 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:20.880779 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31225e5-ca74-4bc6-b146-a8a96018b821 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:20.937979 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:20.938874 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:20.939157 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:20.939429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] PATH_INFO: `/v3/users/50047177f44e48a6890f08ea69e717ab` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:20.940713 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50047177f44e48a6890f08ea69e717ab)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:20.942614 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:21.136506 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50047177f44e48a6890f08ea69e717ab'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.179130 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50047177f44e48a6890f08ea69e717ab'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.179741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50047177f44e48a6890f08ea69e717ab'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.186809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50047177f44e48a6890f08ea69e717ab'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.198907 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-b0823f90-a3d8-45f5-87b2-ffbfbfdcd233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50047177f44e48a6890f08ea69e717ab'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.205150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1455/2839] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:20 2022] DELETE /identity/v3/users/50047177f44e48a6890f08ea69e717ab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:21.585545 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:21.587061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:21.600867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fcf34-13f9-4c27-a4f7-da1bf4b4e39e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:21.660424 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:21.661223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:21.661506 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:21.661786 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] PATH_INFO: `/v3/projects/60682c9cc90548bd9a60cf5317f5248d` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:21.663013 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60682c9cc90548bd9a60cf5317f5248d)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:21.664927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:21.757912 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60682c9cc90548bd9a60cf5317f5248d', 'request_id': 'req-3d8a8637-322f-4961-a52e-50f9fc4e54b6'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.764099 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60682c9cc90548bd9a60cf5317f5248d', 'request_id': 'req-3d8a8637-322f-4961-a52e-50f9fc4e54b6'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.825280 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60682c9cc90548bd9a60cf5317f5248d', 'request_id': 'req-3d8a8637-322f-4961-a52e-50f9fc4e54b6'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.832481 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:21.837223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] The token cache is being invalidate because project 60682c9cc90548bd9a60cf5317f5248d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:21.837504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.838122 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-3d8a8637-322f-4961-a52e-50f9fc4e54b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:21.840005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1385/2840] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:21 2022] DELETE /identity/v3/projects/60682c9cc90548bd9a60cf5317f5248d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:21.844791 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:21.845086 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:21.845368 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:21.864392 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:21.865653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:21.894550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:21.923949 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1456/2841] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:21.932462 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:21.932751 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:21.933028 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:21.959925 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:21.961165 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:21.969355 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1386/2842] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:21.974108 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:21.983641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9d7a8-556e-49e8-b11f-99a6800d908a None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:21.988884 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:21.989581 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:21.989865 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:21.990143 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:21.990893 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:21.991195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:21.992777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.004179 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1457/2843] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:22.009824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.018901 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04ca28-9b3c-4805-857b-deec7ee3681b None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.023514 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.024169 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.024585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.024753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.025441 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.027369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.112229 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1387/2844] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:22 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:22.117373 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.127572 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec074-c345-4a4e-8eca-f7428bfda396 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.182661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.183285 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.183568 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.183844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.184533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.186430 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.299649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1458/2845] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:22 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:22.303750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.314063 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9fd93-96e9-41ea-b2e9-37e9f487084e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.318953 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.319897 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.320024 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.320523 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.320997 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.322615 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.333454 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1388/2846] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:22.337316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.348203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543a8b-071e-44b0-a94d-3b8f2b7fcabd admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.352954 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a3fdc-3753-459a-9e9d-5e7cf80f7356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.353609 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3fdc-3753-459a-9e9d-5e7cf80f7356 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.353895 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3fdc-3753-459a-9e9d-5e7cf80f7356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.354178 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3fdc-3753-459a-9e9d-5e7cf80f7356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.354934 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a3fdc-3753-459a-9e9d-5e7cf80f7356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.356520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a3fdc-3753-459a-9e9d-5e7cf80f7356 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.366498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1459/2847] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:22.370305 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.380131 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee521-ecb6-4255-b6a4-90ab75d9303f admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.384630 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.385500 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.385783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.386294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] PATH_INFO: `/v3/projects/80e31c63fd8a4f0f8a63062984fee994/users/8e421e1012f64f848fff919e79d68bc7/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.401166 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e31c63fd8a4f0f8a63062984fee994, user_id=8e421e1012f64f848fff919e79d68bc7, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.403844 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.477574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1389/2848] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:22 2022] PUT /identity/v3/projects/80e31c63fd8a4f0f8a63062984fee994/users/8e421e1012f64f848fff919e79d68bc7/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:58:22.487655 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.487960 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.488238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.514787 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] MFA Rules not processed for user `8e421e1012f64f848fff919e79d68bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:22.516016 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:22.579675 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1460/2849] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:22.585005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.645059 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885ac1-3df1-4b69-b885-553847b51ec2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.649731 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.650383 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.650666 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.650971 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.651662 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.653558 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.729824 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1390/2850] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:22 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:22.733899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.745089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af216a70-bc55-4f9c-9e6a-7400bebdf5f4 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.771626 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:22.802485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.807840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.807840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.807840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.807840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.807840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.876316 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1461/2851] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:22 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:22.880843 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.891284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3342d-8f41-4c15-a8c7-27ce167e606d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.896723 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.897384 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.897670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.897978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.898735 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.900362 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:22.910988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1391/2852] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:22.923233 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:22.934232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494f64-e410-4c55-b21d-e3b0af6e330a admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:22.938926 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:22.939804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:22.940109 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:22.940389 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] PATH_INFO: `/v3/projects/2ac07848a7dc48c2a51e29778399d3b1/users/ab4dc0bf1f6d483e9613d2efd1e682b5/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:22.955559 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac07848a7dc48c2a51e29778399d3b1, user_id=ab4dc0bf1f6d483e9613d2efd1e682b5, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:22.959240 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:23.031135 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1462/2853] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:22 2022] PUT /identity/v3/projects/2ac07848a7dc48c2a51e29778399d3b1/users/ab4dc0bf1f6d483e9613d2efd1e682b5/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:23.035121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:23.045279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba0864-6064-4550-9af7-e38883a51d93 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:23.101938 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118b24-5b28-451b-bd87-f0633061e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:23.102634 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118b24-5b28-451b-bd87-f0633061e835 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:23.102956 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118b24-5b28-451b-bd87-f0633061e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:23.103266 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118b24-5b28-451b-bd87-f0633061e835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:23.103996 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118b24-5b28-451b-bd87-f0633061e835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:23.105574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118b24-5b28-451b-bd87-f0633061e835 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:23.116130 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1392/2854] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:58:23.120198 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:23.131257 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbd068-3f36-4298-bd24-bdf6e637edbe admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:23.135815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:23.136689 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:23.136969 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:23.137238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] PATH_INFO: `/v3/projects/2ac07848a7dc48c2a51e29778399d3b1/users/ab4dc0bf1f6d483e9613d2efd1e682b5/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:23.139246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac07848a7dc48c2a51e29778399d3b1, user_id=ab4dc0bf1f6d483e9613d2efd1e682b5, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:23.141844 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:23.152017 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1463/2855] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:23 2022] PUT /identity/v3/projects/2ac07848a7dc48c2a51e29778399d3b1/users/ab4dc0bf1f6d483e9613d2efd1e682b5/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:23.162420 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:23.162739 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:23.163026 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:23.169685 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:23.188988 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] MFA Rules not processed for user `ab4dc0bf1f6d483e9613d2efd1e682b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:23.190338 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:23.259379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1393/2856] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:23.270730 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:23.272429 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:23.328051 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c86fef-a4af-4cdc-b1fe-085415d8c93b admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:23.331901 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:23.332516 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:23.332796 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:23.333069 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:23.341885 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:23.343327 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:23.353150 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1464/2857] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:23.570023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:23.580101 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c3ac-f5b1-4f43-a798-5e5d8cb3bbf6 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:23.583950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5fe2-caa9-4adf-bb2c-388dd589c4f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:23.584584 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5fe2-caa9-4adf-bb2c-388dd589c4f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:23.584867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5fe2-caa9-4adf-bb2c-388dd589c4f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:23.585143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5fe2-caa9-4adf-bb2c-388dd589c4f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:23.641698 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c5fe2-caa9-4adf-bb2c-388dd589c4f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:23.643196 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c5fe2-caa9-4adf-bb2c-388dd589c4f6 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:23.652439 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1394/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:29.726434 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:29.791371 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e65a-5b00-4e41-bc61-a67013c86d7e service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:29.795935 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:29.796806 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:29.797090 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:29.797359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] PATH_INFO: `/v3/users/8e421e1012f64f848fff919e79d68bc7` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:29.798549 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e421e1012f64f848fff919e79d68bc7)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:29.801014 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:29.917680 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:30.038739 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e421e1012f64f848fff919e79d68bc7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.105186 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e421e1012f64f848fff919e79d68bc7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.105790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e421e1012f64f848fff919e79d68bc7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.113399 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e421e1012f64f848fff919e79d68bc7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.124741 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e421e1012f64f848fff919e79d68bc7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.131645 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1465/2859] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:29 2022] DELETE /identity/v3/users/8e421e1012f64f848fff919e79d68bc7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:30.136444 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:30.137035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:30.137035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:30.153509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:30.154813 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:30.213034 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1395/2860] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 10:58:30.223308 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:30.224707 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:30.281450 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07e312-649f-4b92-9417-daae9b414a10 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:30.285847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:30.286489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:30.286804 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:30.287084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:30.296243 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:30.297625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:30.307712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1466/2861] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 10:58:30.764344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:30.764706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:30.777697 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6eda-5763-4fd1-b83d-c372ceba14e0 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:30.787146 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:30.788082 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:30.788364 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:30.788638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] PATH_INFO: `/v3/projects/80e31c63fd8a4f0f8a63062984fee994` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:30.789950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e31c63fd8a4f0f8a63062984fee994)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:30.798737 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:30.824507 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:30.916180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e31c63fd8a4f0f8a63062984fee994', 'request_id': 'req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.922410 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e31c63fd8a4f0f8a63062984fee994', 'request_id': 'req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:30.990678 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e31c63fd8a4f0f8a63062984fee994', 'request_id': 'req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.001339 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] The token cache is being invalidate because project 80e31c63fd8a4f0f8a63062984fee994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:31.001755 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.002337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.004463 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1396/2862] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:30 2022] DELETE /identity/v3/projects/80e31c63fd8a4f0f8a63062984fee994 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:31.008451 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:31.018315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486188b0-7588-4d32-a03f-155336c6e0e5 service neutron] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:31.074195 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:31.075204 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:31.075386 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:31.075662 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] PATH_INFO: `/v3/users/ab4dc0bf1f6d483e9613d2efd1e682b5` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:31.076866 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4dc0bf1f6d483e9613d2efd1e682b5)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:31.078827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:31.317520 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4dc0bf1f6d483e9613d2efd1e682b5'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.319268 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:31.389512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4dc0bf1f6d483e9613d2efd1e682b5'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.390067 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4dc0bf1f6d483e9613d2efd1e682b5'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.397887 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4dc0bf1f6d483e9613d2efd1e682b5'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.409359 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-1d1b915f-f489-4837-afbb-a3d764b4a856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4dc0bf1f6d483e9613d2efd1e682b5'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:31.415248 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1467/2863] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:31 2022] DELETE /identity/v3/users/ab4dc0bf1f6d483e9613d2efd1e682b5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:31.815480 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:31.817447 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:31.830676 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3fbb-3e01-4581-877b-dafde4cc15d5 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:31.887661 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:31.888548 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:31.888825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:31.889095 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] PATH_INFO: `/v3/projects/2ac07848a7dc48c2a51e29778399d3b1` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:31.890264 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac07848a7dc48c2a51e29778399d3b1)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:31.892188 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.012340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac07848a7dc48c2a51e29778399d3b1', 'request_id': 'req-baa6c0ef-d768-4048-b068-25071174d441'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:32.019225 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac07848a7dc48c2a51e29778399d3b1', 'request_id': 'req-baa6c0ef-d768-4048-b068-25071174d441'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:32.080849 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac07848a7dc48c2a51e29778399d3b1', 'request_id': 'req-baa6c0ef-d768-4048-b068-25071174d441'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:32.091773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] The token cache is being invalidate because project 2ac07848a7dc48c2a51e29778399d3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:32.092051 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:32.092663 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-baa6c0ef-d768-4048-b068-25071174d441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:32.094186 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1397/2864] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:31 2022] DELETE /identity/v3/projects/2ac07848a7dc48c2a51e29778399d3b1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:32.099962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.100446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.100560 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.117772 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:32.119006 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:32.177381 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1468/2865] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:32.237365 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.237648 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.237922 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.256080 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:32.257279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:32.265138 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1398/2866] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:32.269836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.279641 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571713-1c5f-47ba-8ba9-3b102e2a8f98 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.284931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.285608 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.285890 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.286163 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.286925 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:32.287232 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.288808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.300326 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1469/2867] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:32.304706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.313976 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233985ae-eaad-46c6-b675-641f38127f7f None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.319180 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.319825 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.320106 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.320379 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.321075 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.322980 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.402760 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1399/2868] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:32 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:32.406809 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.416973 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd28f45-8849-4580-b969-5ef35fd0c760 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.472854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.473522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.473807 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.474084 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.474803 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.476715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.549705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1470/2869] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:32 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:32.553733 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.564044 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa7f9b-791f-4521-b499-9396c4e82e46 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.569388 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.570042 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.570322 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.570620 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.571386 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.572968 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.584211 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1400/2870] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:32.588114 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.598324 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695de110-64d5-476f-9d54-637e25fcdae1 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.602978 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dcfdf-e4f5-489b-846d-b69916c24a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.603634 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dcfdf-e4f5-489b-846d-b69916c24a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.603923 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dcfdf-e4f5-489b-846d-b69916c24a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.604203 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dcfdf-e4f5-489b-846d-b69916c24a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.604936 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dcfdf-e4f5-489b-846d-b69916c24a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.606522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dcfdf-e4f5-489b-846d-b69916c24a98 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.616780 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1471/2871] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:32.620693 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.625927 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:32.631775 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545db0-bde6-448e-a3fd-5a651a1dbcb6 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.636335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.637204 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.637478 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.637743 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] PATH_INFO: `/v3/projects/6418f612847744b6a41a0bd211bc645f/users/219a942737164631a9ad6510fd90a2a8/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.652509 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6418f612847744b6a41a0bd211bc645f, user_id=219a942737164631a9ad6510fd90a2a8, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.655575 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.722344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1401/2872] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:32 2022] PUT /identity/v3/projects/6418f612847744b6a41a0bd211bc645f/users/219a942737164631a9ad6510fd90a2a8/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:32.733166 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.733460 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.733742 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.760831 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] MFA Rules not processed for user `219a942737164631a9ad6510fd90a2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:32.762035 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:32.780139 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:32.824854 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1472/2873] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:32.835670 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:32.837476 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:32.893950 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3d444-e9e4-4cac-bd1b-e50d122e153e admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:32.897645 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b463-e6ea-4230-9c60-95b97dd64285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:32.898284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b463-e6ea-4230-9c60-95b97dd64285 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:32.898563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b463-e6ea-4230-9c60-95b97dd64285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:32.898871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b463-e6ea-4230-9c60-95b97dd64285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:32.907033 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b463-e6ea-4230-9c60-95b97dd64285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:32.908445 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b463-e6ea-4230-9c60-95b97dd64285 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:32.917195 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1402/2874] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:36.913862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:36.975765 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8c70-844d-4181-94f2-af3b85dac5d5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:36.980328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:36.981192 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:36.981471 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:36.981744 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] PATH_INFO: `/v3/users/219a942737164631a9ad6510fd90a2a8` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:36.982940 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=219a942737164631a9ad6510fd90a2a8)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:36.984847 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:37.164025 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219a942737164631a9ad6510fd90a2a8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:37.247601 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219a942737164631a9ad6510fd90a2a8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:37.248221 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219a942737164631a9ad6510fd90a2a8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:37.255851 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219a942737164631a9ad6510fd90a2a8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:37.267808 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219a942737164631a9ad6510fd90a2a8'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:37.274492 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1473/2875] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:36 2022] DELETE /identity/v3/users/219a942737164631a9ad6510fd90a2a8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:37.279027 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:37.279512 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:37.279642 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:37.297284 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:37.298495 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:37.356812 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1403/2876] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:37.366498 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:37.367933 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:37.411387 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:37.424737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750403-b2c9-49d9-b22a-ea0fb1d7aadc admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:37.428681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef35b1-5afa-48ef-afb3-500e7b2cb494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:37.430045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef35b1-5afa-48ef-afb3-500e7b2cb494 service neutron] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:37.430045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef35b1-5afa-48ef-afb3-500e7b2cb494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:37.430045 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef35b1-5afa-48ef-afb3-500e7b2cb494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:37.439102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef35b1-5afa-48ef-afb3-500e7b2cb494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:37.440525 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef35b1-5afa-48ef-afb3-500e7b2cb494 service neutron] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:37.450615 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1474/2877] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:37.902066 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:37.903546 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:37.917277 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3ffe9-6294-4442-a68b-2a937794e6f4 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:37.922152 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:37.923052 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:37.923337 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:37.923618 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] PATH_INFO: `/v3/projects/6418f612847744b6a41a0bd211bc645f` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:37.924934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6418f612847744b6a41a0bd211bc645f)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:37.927294 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.025837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6418f612847744b6a41a0bd211bc645f', 'request_id': 'req-0a068701-a466-4ee8-b550-fef3ac72f951'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:38.032023 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6418f612847744b6a41a0bd211bc645f', 'request_id': 'req-0a068701-a466-4ee8-b550-fef3ac72f951'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:38.093759 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6418f612847744b6a41a0bd211bc645f', 'request_id': 'req-0a068701-a466-4ee8-b550-fef3ac72f951'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:38.104688 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] The token cache is being invalidate because project 6418f612847744b6a41a0bd211bc645f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:38.104994 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:38.105617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-0a068701-a466-4ee8-b550-fef3ac72f951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:38.110369 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1404/2878] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:37 2022] DELETE /identity/v3/projects/6418f612847744b6a41a0bd211bc645f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:38.112213 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.112706 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.112821 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.131356 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:38.132553 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:38.190102 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1475/2879] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:38.198638 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.199035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.199316 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.206761 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:38.218307 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:38.219525 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:38.227931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1405/2880] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:38.233653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.244073 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d883ad-1d32-4807-820b-6383b8728623 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.248622 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.249313 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.249597 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.249871 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] PATH_INFO: `/v3/domains` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.250596 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 10:58:38.250931 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.252522 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.264786 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1476/2881] 10.222.0.49 () {58 vars in 1152 bytes} [Thu Jul 21 10:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 10:58:38.269125 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.278193 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da266fc-62bb-49e5-8c9b-9ae8bfe29cbc None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.282852 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.283504 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.283785 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.284057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.284753 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.287217 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.390479 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1406/2882] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:38 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 10:58:38.394842 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.404966 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb42c2-6b00-4d5c-8b11-154414b12677 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.460049 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.460715 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.461000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.461275 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.461970 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.463902 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.549732 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1477/2883] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:38 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:38.554887 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.565221 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010dbdf-0735-40b4-83d3-7fc02050576d admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.569972 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.570632 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.570946 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.571222 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.571952 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.573549 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.584358 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1407/2884] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 10:58:38.588394 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.599068 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bbace-ce5e-44b1-892d-dd718e32e30f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.603777 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf8d05-1066-436e-bf92-afdc665e4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.604435 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf8d05-1066-436e-bf92-afdc665e4978 admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.604723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf8d05-1066-436e-bf92-afdc665e4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.605003 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf8d05-1066-436e-bf92-afdc665e4978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.605738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf8d05-1066-436e-bf92-afdc665e4978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.607360 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf8d05-1066-436e-bf92-afdc665e4978 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.617991 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1478/2885] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:38.621871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.631783 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c986f-e01b-4cc7-82ea-97a117554883 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.636340 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.637216 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.637493 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.637766 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] PATH_INFO: `/v3/projects/e2b70a384f144aee95f19353d1d72782/users/b15b0c71f9fe4ad08e446167a570b923/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.651830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b70a384f144aee95f19353d1d72782, user_id=b15b0c71f9fe4ad08e446167a570b923, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.654456 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:38.729035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1408/2886] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:38 2022] PUT /identity/v3/projects/e2b70a384f144aee95f19353d1d72782/users/b15b0c71f9fe4ad08e446167a570b923/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:38.740720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.741712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.741712 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.768612 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] MFA Rules not processed for user `b15b0c71f9fe4ad08e446167a570b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:38.772473 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:38.814996 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:38.841489 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1479/2887] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:38.841715 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:38.901780 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9dc38-f2f3-4076-be23-cc2e26125832 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:38.906343 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:38.907035 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:38.907313 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:38.907587 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:38.908272 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:38.910837 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.007274 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1409/2888] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:38 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:39.011527 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.023048 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29030609-8df2-4622-9a79-66be1f87eacf None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.081238 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.081836 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.082799 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.083089 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.083800 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.085720 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.196314 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1480/2889] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:39 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:39.200281 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.212533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a784abd-10e9-4778-a531-03543aa078c8 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.217072 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.217736 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.218017 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.218293 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.219061 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.220654 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.231162 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1410/2890] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:39.235096 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.245288 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7804d-9403-49d5-aafb-d1a20684c830 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.249810 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4282f-09d5-4c43-b8ff-c53339ea26bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.250458 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4282f-09d5-4c43-b8ff-c53339ea26bb admin admin] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.250815 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4282f-09d5-4c43-b8ff-c53339ea26bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.251101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4282f-09d5-4c43-b8ff-c53339ea26bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.251827 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4282f-09d5-4c43-b8ff-c53339ea26bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.253400 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4282f-09d5-4c43-b8ff-c53339ea26bb admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.264001 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1481/2891] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:39.267867 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.278711 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f097-f5a2-463f-a2ad-376e3a448c83 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.283249 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.284124 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.284405 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.284681 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] PATH_INFO: `/v3/projects/c2b0d89334b84cb494ed40757436f11d/users/f005a755262549f88d10908a444cbb04/roles/6cacf0328bf641858367cd5fa14f09e2` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.299126 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b0d89334b84cb494ed40757436f11d, user_id=f005a755262549f88d10908a444cbb04, role_id=6cacf0328bf641858367cd5fa14f09e2)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.302007 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.366416 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1411/2892] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:39 2022] PUT /identity/v3/projects/c2b0d89334b84cb494ed40757436f11d/users/f005a755262549f88d10908a444cbb04/roles/6cacf0328bf641858367cd5fa14f09e2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:39.376547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.376863 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.377141 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.403656 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] MFA Rules not processed for user `f005a755262549f88d10908a444cbb04`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:39.404857 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:39.470328 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1482/2893] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:39.475183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.527981 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:39.539311 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6371f3-bcbe-415c-b197-95a937ad6a35 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.544025 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.544679 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.544963 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.545238 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.545934 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.547864 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.632750 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1412/2894] 10.222.0.49 () {60 vars in 1152 bytes} [Thu Jul 21 10:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:39.636768 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.647575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10deff0-4308-4d07-b6f7-55a34b997003 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.690534 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:39.704000 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.704927 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.705211 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.705514 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.706220 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.708252 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.807879 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1483/2895] 10.222.0.49 () {60 vars in 1143 bytes} [Thu Jul 21 10:58:39 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 10:58:39.811464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.822121 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01282-9b9f-4d13-acb3-df27d9016651 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.826942 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.828111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.828111 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.828315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.828931 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.830810 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.841409 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1413/2896] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:39.845385 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.856012 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ea5d-55e8-401c-80d9-3196cc8714f7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:39.860652 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:39.861523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:39.861805 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:39.862081 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] PATH_INFO: `/v3/projects/8fe43329c9624d7abac47865f75e3d3d/users/4ede7e6fac0b4abcb079f6012f109357/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:39.877485 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe43329c9624d7abac47865f75e3d3d, user_id=4ede7e6fac0b4abcb079f6012f109357, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:39.880448 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:39.962306 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1484/2897] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:39 2022] PUT /identity/v3/projects/8fe43329c9624d7abac47865f75e3d3d/users/4ede7e6fac0b4abcb079f6012f109357/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:39.966198 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:39.976800 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27331da4-44da-4e16-af68-5697257d9002 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:40.031911 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df00a17-1562-4257-8e40-378d4ccdbf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:40.032585 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df00a17-1562-4257-8e40-378d4ccdbf8e admin admin] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:40.032871 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df00a17-1562-4257-8e40-378d4ccdbf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:40.033143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df00a17-1562-4257-8e40-378d4ccdbf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:40.033877 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df00a17-1562-4257-8e40-378d4ccdbf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:40.036018 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df00a17-1562-4257-8e40-378d4ccdbf8e admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:40.045664 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1414/2898] 10.222.0.49 () {58 vars in 1121 bytes} [Thu Jul 21 10:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 10:58:40.049790 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:40.061111 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0f140-aee5-4e40-ab90-d64c60ff847c admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:40.065705 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:40.066661 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:40.066986 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:40.067264 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] PATH_INFO: `/v3/projects/8fe43329c9624d7abac47865f75e3d3d/users/4ede7e6fac0b4abcb079f6012f109357/roles/5378a78ce3ee497fa1b16a7c4a71bc29` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:40.069262 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe43329c9624d7abac47865f75e3d3d, user_id=4ede7e6fac0b4abcb079f6012f109357, role_id=5378a78ce3ee497fa1b16a7c4a71bc29)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:40.071921 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:40.082440 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1485/2899] 10.222.0.49 () {60 vars in 1482 bytes} [Thu Jul 21 10:58:40 2022] PUT /identity/v3/projects/8fe43329c9624d7abac47865f75e3d3d/users/4ede7e6fac0b4abcb079f6012f109357/roles/5378a78ce3ee497fa1b16a7c4a71bc29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:40.093402 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] REQUEST_METHOD: `POST` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:40.093695 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:40.093978 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:40.121408 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.auth.core [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] MFA Rules not processed for user `4ede7e6fac0b4abcb079f6012f109357`. Rule list: `[]` (Enabled: `True`). {{(pid=80595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:40.122633 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:40.191330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1415/2900] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:40.202512 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:40.204518 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:40.261513 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b0c56-d1c2-461b-ac83-9dae9dfff971 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:40.265072 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:40.265738 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:40.266022 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:40.266297 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:40.321584 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:40.323066 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:40.332723 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1486/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:42.290149 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:42.291573 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:42.304646 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121f789-bbc6-46c0-a951-65ef6426a886 None None] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:42.308315 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:42.308947 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:42.309227 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:42.309498 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:42.354562 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:42.367142 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:42.368617 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:42.377344 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1416/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:43.742113 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:43.750737 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff19824-9b30-492e-aaad-aca03a382716 service cinder] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:43.754899 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ac3c2-9053-4929-98fb-bc6d04f07b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d129919be4586b6e1c9d1fed498b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:43.755541 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ac3c2-9053-4929-98fb-bc6d04f07b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:43.755822 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ac3c2-9053-4929-98fb-bc6d04f07b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:43.756097 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ac3c2-9053-4929-98fb-bc6d04f07b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:43.764894 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ac3c2-9053-4929-98fb-bc6d04f07b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:43.766315 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ac3c2-9053-4929-98fb-bc6d04f07b18 service cinder] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:43.777215 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1487/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:48.227268 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:48.290241 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23ba37-eb6d-4066-ac82-23cd9f629bf4 service cinder] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:48.294830 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:48.295721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:48.296005 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:48.296279 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] PATH_INFO: `/v3/users/b15b0c71f9fe4ad08e446167a570b923` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:48.297465 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15b0c71f9fe4ad08e446167a570b923)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:48.299419 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:48.510741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15b0c71f9fe4ad08e446167a570b923'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:48.583327 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15b0c71f9fe4ad08e446167a570b923'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:48.596292 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15b0c71f9fe4ad08e446167a570b923'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:48.596919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15b0c71f9fe4ad08e446167a570b923'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:48.604872 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15b0c71f9fe4ad08e446167a570b923'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:48.610919 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1417/2904] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:48 2022] DELETE /identity/v3/users/b15b0c71f9fe4ad08e446167a570b923 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 10:58:48.615453 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] REQUEST_METHOD: `POST` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:48.616504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:48.616504 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:48.632818 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.auth.core [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] MFA Rules not processed for user `3d9602c060d644089af9ad7f45e2a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 10:58:48.634032 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:48.667840 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:48.691958 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1488/2905] 10.222.0.49 () {58 vars in 957 bytes} [Thu Jul 21 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 10:58:48.701721 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:48.703144 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:48.762330 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af3f3-09f2-4cbf-bedb-4e2d1acf5130 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:48.765853 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827c5b6ddf0b4e899dd0c2ab3e05b0d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:48.766497 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:48.766821 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:48.767100 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:48.777128 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:48.778582 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:48.788485 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1418/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 10:58:49.191752 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:49.191904 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:49.203911 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136e1f-8388-4093-820a-9cc6489734b5 None None] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:49.208862 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:49.210681 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:49.211121 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:49.211413 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] PATH_INFO: `/v3/projects/e2b70a384f144aee95f19353d1d72782` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:49.212691 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b70a384f144aee95f19353d1d72782)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:49.214625 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:49.367533 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b70a384f144aee95f19353d1d72782', 'request_id': 'req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.373653 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b70a384f144aee95f19353d1d72782', 'request_id': 'req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.434496 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b70a384f144aee95f19353d1d72782', 'request_id': 'req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.445647 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] The token cache is being invalidate because project e2b70a384f144aee95f19353d1d72782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:49.449523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.449523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.449523 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1489/2907] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:49 2022] DELETE /identity/v3/projects/e2b70a384f144aee95f19353d1d72782 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:49.452173 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:49.462957 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c365-44ed-48df-848e-e5866632e578 service neutron] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:49.466533 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:49.519894 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:49.520773 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:49.521057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:49.521335 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] PATH_INFO: `/v3/users/f005a755262549f88d10908a444cbb04` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:49.522554 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f005a755262549f88d10908a444cbb04)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:49.525499 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:49.702009 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f005a755262549f88d10908a444cbb04'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.790625 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f005a755262549f88d10908a444cbb04'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.802948 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f005a755262549f88d10908a444cbb04'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.808143 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f005a755262549f88d10908a444cbb04'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.810450 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f005a755262549f88d10908a444cbb04'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:49.816387 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1419/2908] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:49 2022] DELETE /identity/v3/users/f005a755262549f88d10908a444cbb04 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:50.453486 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:50.455354 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:50.468987 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7da95-3cc9-470b-b3f3-9b0941cb34e7 admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:50.530101 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:50.530998 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:50.531280 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:50.531550 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] PATH_INFO: `/v3/projects/c2b0d89334b84cb494ed40757436f11d` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:50.532721 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b0d89334b84cb494ed40757436f11d)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:50.534624 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:50.641309 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b0d89334b84cb494ed40757436f11d', 'request_id': 'req-2f274a20-63c6-4749-be46-77aeb6c3121f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:50.647446 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b0d89334b84cb494ed40757436f11d', 'request_id': 'req-2f274a20-63c6-4749-be46-77aeb6c3121f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:50.728246 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b0d89334b84cb494ed40757436f11d', 'request_id': 'req-2f274a20-63c6-4749-be46-77aeb6c3121f'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:50.732700 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:50.740281 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] The token cache is being invalidate because project c2b0d89334b84cb494ed40757436f11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:50.742217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:50.742217 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:50.742962 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1490/2909] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:50 2022] DELETE /identity/v3/projects/c2b0d89334b84cb494ed40757436f11d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:50.747016 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:50.748563 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:50.761706 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffd98e-c819-4e29-a355-d2a305b7ded2 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:50.818223 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:50.822501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:50.822501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:50.822501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] PATH_INFO: `/v3/users/4ede7e6fac0b4abcb079f6012f109357` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:50.822501 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ede7e6fac0b4abcb079f6012f109357)` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:50.822954 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:50.911090 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:51.016671 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ede7e6fac0b4abcb079f6012f109357'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.156446 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ede7e6fac0b4abcb079f6012f109357'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.169286 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ede7e6fac0b4abcb079f6012f109357'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.169964 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ede7e6fac0b4abcb079f6012f109357'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.177057 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.notifications [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ede7e6fac0b4abcb079f6012f109357'} {{(pid=80595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.184006 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1420/2910] 10.222.0.49 () {58 vars in 1223 bytes} [Thu Jul 21 10:58:50 2022] DELETE /identity/v3/users/4ede7e6fac0b4abcb079f6012f109357 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:58:51.590398 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Authenticating user token {{(pid=80594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 10:58:51.591944 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.fernet_utils [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 10:58:51.605575 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274a20-63c6-4749-be46-77aeb6c3121f admin admin] Validating token access rules against request {{(pid=80594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 10:58:51.662649 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d9602c060d644089af9ad7f45e2a55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1821efd315e44bfda0a46040701ac779', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 10:58:51.663670 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 10:58:51.663961 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 10:58:51.664236 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] PATH_INFO: `/v3/projects/8fe43329c9624d7abac47865f75e3d3d` {{(pid=80594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 10:58:51.665414 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe43329c9624d7abac47865f75e3d3d)` {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 10:58:51.667483 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] RBAC: Authorization granted {{(pid=80594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 10:58:51.790547 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe43329c9624d7abac47865f75e3d3d', 'request_id': 'req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.796788 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe43329c9624d7abac47865f75e3d3d', 'request_id': 'req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.874479 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe43329c9624d7abac47865f75e3d3d', 'request_id': 'req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e'} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.885335 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] The token cache is being invalidate because project 8fe43329c9624d7abac47865f75e3d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 10:58:51.888642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.888642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG keystone.notifications [None req-e44a6b73-f3a9-4570-90cd-0bc1c906f52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 10:58:51.888642 dv-cinder-849800-2-smb devstack@keystone.service[80594]: [pid: 80594|app: 0|req: 1491/2911] 10.222.0.49 () {58 vars in 1232 bytes} [Thu Jul 21 10:58:51 2022] DELETE /identity/v3/projects/8fe43329c9624d7abac47865f75e3d3d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 10:59:01.180228 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:01.881875 dv-cinder-849800-2-smb devstack@keystone.service[80594]: DEBUG dbcounter [-] [80594] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=80594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:24.104990 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Authenticating user token {{(pid=80595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 11:00:24.106464 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 11:00:24.177845 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c820559-369e-437d-bf3c-ca8eccaa5163 admin admin] Validating token access rules against request {{(pid=80595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 11:00:24.236574 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5034e89eb64bd6bbc0d02f2da909c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c492b68bdd7347c7bf9891000153c799', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 11:00:24.237219 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] REQUEST_METHOD: `GET` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 11:00:24.237517 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] SCRIPT_NAME: `/identity` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 11:00:24.237818 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 11:00:24.239741 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.fernet_utils [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 11:00:24.252183 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 11:00:24.253745 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08916-8e99-4917-b173-7c0361f12044 service placement] RBAC: Authorization granted {{(pid=80595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 11:00:24.264903 dv-cinder-849800-2-smb devstack@keystone.service[80595]: [pid: 80595|app: 0|req: 1421/2912] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Jul 21 11:00:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 11:00:34.260998 dv-cinder-849800-2-smb devstack@keystone.service[80595]: DEBUG dbcounter [-] [80595] Writing DB stats keystone:SELECT=58 {{(pid=80595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}